2015-02-10 19:08:12,834 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 19:08:12,898 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-10 19:08:12,898 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.detail.EveryPipeAssemblyPlatformTest
2015-02-10 19:08:13,015 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,034 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,044 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,055 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,066 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,067 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,078 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,089 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,089 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,100 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,111 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,112 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,119 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,121 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,122 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,122 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,123 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,124 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,124 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,131 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,132 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,140 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,140 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,150 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,159 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,168 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,178 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,187 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,194 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,195 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,202 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,210 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,210 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,215 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,219 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,220 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,224 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,225 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,225 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,226 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,226 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,227 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,228 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,232 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,232 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,236 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,236 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,240 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,244 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,248 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,252 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,257 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,261 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,262 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,266 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,271 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,271 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,278 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,285 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,286 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,293 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,293 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,294 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,294 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,295 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,295 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,296 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,296 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,296 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,297 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,297 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,298 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 19:08:13,322 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-02-10 19:08:13,982 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 19:08:14,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:14,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:14,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:14,225 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:14,227 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:14,239 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: B58193E0500846279FF993F44E7F5973
2015-02-10 19:08:14,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:14,384 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:14,387 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:14,499 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 19:08:14,504 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:14,505 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:14,506 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-10 19:08:14,506 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:14,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:14,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:14,510 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_'field'_-1
2015-02-10 19:08:14,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-02-10 19:08:14,535 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-02-10 19:08:14,562 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:14,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:14,980 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:15,023 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:15,044 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:15,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:15,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:15,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:15,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:15,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:15,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:15,048 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:15,048 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:15,049 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:15,049 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:15,050 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:15,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:15,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:15,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:15,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:15,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:15,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:15,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:15,054 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:15,055 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:15,055 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:15,056 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:15,057 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:15,057 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:15,058 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:15,058 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:15,058 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:15,058 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:15,059 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:15,059 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:15,059 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:15,059 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:15,060 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:15,060 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:15,060 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:15,060 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:15,061 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:15,061 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:15,061 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:15,061 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:15,062 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:15,062 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:15,062 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:15,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:15,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:15,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:15,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:15,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:15,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:15,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:15,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:15,065 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:15,065 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:15,065 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:15,065 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:15,066 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:15,066 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:15,066 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:15,066 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:15,067 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:15,067 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:15,067 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:15,070 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:15,070 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:15,070 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:15,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:15,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:15,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:15,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:15,072 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:15,072 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:15,072 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:15,073 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:15,073 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:15,073 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:15,073 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:15,074 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:15,074 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:15,074 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:15,074 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:15,075 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:15,075 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:15,075 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:15,075 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:15,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:15,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:15,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:15,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:15,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:15,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:15,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:15,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:15,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:15,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:15,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:15,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:15,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:15,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:15,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:15,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:15,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:15,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:15,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:15,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:15,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:15,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:15,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:15,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:15,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:15,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:15,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:15,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:15,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:15,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:15,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:15,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:15,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:15,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:15,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:15,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:15,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:15,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:15,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:15,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:15,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:15,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:15,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:15,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:15,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:15,240 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1490936376_0001
2015-02-10 19:08:15,286 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1490936376/.staging/job_local1490936376_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:15,297 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1490936376/.staging/job_local1490936376_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:15,424 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1490936376_0001/job_local1490936376_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:15,424 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1490936376_0001/job_local1490936376_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:15,444 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:15,445 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:15,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1490936376_0001
2015-02-10 19:08:15,449 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:15,449 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:15,488 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:15,492 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1490936376_0001_m_000000_0
2015-02-10 19:08:15,533 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:15,543 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:15,544 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7593c366
2015-02-10 19:08:15,553 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:15,560 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:15,707 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:15,708 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:15,708 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:15,708 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:15,708 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:15,729 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:15,730 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:15,774 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2015-02-10 19:08:15,777 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:15,778 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:15,806 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:15,806 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:15,806 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:15,806 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:15,807 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:15,820 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:15,825 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1490936376_0001_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:15,833 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:15,833 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1490936376_0001_m_000000_0' done.
2015-02-10 19:08:15,833 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1490936376_0001_m_000000_0
2015-02-10 19:08:15,834 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:15,848 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:15,854 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:15,860 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:15,861 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:15,862 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:15,863 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:15,887 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:15,888 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-10 19:08:15,916 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1490936376_0001_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:15,918 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:15,918 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1490936376_0001_r_000000_0 is allowed to commit now
2015-02-10 19:08:15,919 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1490936376_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary/0/task_local1490936376_0001_r_000000
2015-02-10 19:08:15,921 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:15,921 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1490936376_0001_r_000000_0' done.
2015-02-10 19:08:15,964 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary
2015-02-10 19:08:15,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:15,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:15,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:15,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:15,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:15,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:15,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:15,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:15,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:15,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:15,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:15,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:15,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:15,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:15,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:15,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:15,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:15,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:15,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:15,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:15,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:15,990 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:15,990 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:15,990 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:15,991 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:15,991 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:15,991 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:15,991 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:15,992 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:15,992 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:15,992 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:15,992 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:15,993 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:15,993 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:15,993 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:15,994 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:15,994 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:15,994 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:15,994 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:15,995 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:15,995 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:15,995 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:15,996 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:15,996 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:15,996 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:15,997 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:15,997 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:15,997 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:15,998 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:15,998 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:15,998 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:15,998 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:15,999 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:15,999 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:15,999 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:16,000 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:16,000 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:16,000 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:16,001 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:16,001 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:16,001 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:16,001 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:16,002 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:16,002 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:16,002 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:16,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:16,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:16,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:16,004 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:16,004 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:16,004 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:16,004 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:16,005 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:16,005 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:16,005 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:16,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:16,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:16,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:16,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:16,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:16,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:16,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:16,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:16,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:16,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:16,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:16,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:16,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:16,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:16,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:16,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:16,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:16,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:16,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:16,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:16,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:16,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:16,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:16,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:16,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:16,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:16,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:16,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:16,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:16,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:16,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:16,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:16,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:16,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:16,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:16,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:16,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:16,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:16,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:16,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:16,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:16,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:16,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:16,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:16,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:16,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:16,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:16,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:16,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:16,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:16,039 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:16,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:16,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:16,068 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:16,085 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:16,088 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1
2015-02-10 19:08:16,107 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:16,112 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:16,113 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:16,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:16,159 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-10 19:08:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:16,161 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_'field'
2015-02-10 19:08:16,162 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:16,164 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:16,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:16,198 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:16,223 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:16,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:16,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:16,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:16,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:16,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:16,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:16,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:16,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:16,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:16,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:16,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:16,270 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local358770474_0002
2015-02-10 19:08:16,296 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity358770474/.staging/job_local358770474_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:16,305 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity358770474/.staging/job_local358770474_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:16,379 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local358770474_0002/job_local358770474_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:16,380 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local358770474_0002/job_local358770474_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:16,384 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:16,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local358770474_0002
2015-02-10 19:08:16,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:16,384 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:16,385 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:16,390 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:16,391 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local358770474_0002_m_000000_0
2015-02-10 19:08:16,393 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:16,395 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:16,395 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@54b4b0a4
2015-02-10 19:08:16,397 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:16,398 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:16,547 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:16,547 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:16,547 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:16,547 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:16,547 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:16,549 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:16,549 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:16,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:16,561 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:16,565 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:16,565 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:16,566 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:16,566 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:16,566 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:16,571 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:16,575 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local358770474_0002_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:16,577 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:16,578 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local358770474_0002_m_000000_0' done.
2015-02-10 19:08:16,578 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local358770474_0002_m_000000_0
2015-02-10 19:08:16,578 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:16,586 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:16,587 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:16,588 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:16,588 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:16,589 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:16,589 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:16,601 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:16,601 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-10 19:08:16,618 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local358770474_0002_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:16,620 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:16,620 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local358770474_0002_r_000000_0 is allowed to commit now
2015-02-10 19:08:16,621 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local358770474_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary/0/task_local358770474_0002_r_000000
2015-02-10 19:08:16,623 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:16,624 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local358770474_0002_r_000000_0' done.
2015-02-10 19:08:16,649 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary
2015-02-10 19:08:16,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:16,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:16,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:16,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:16,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:16,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:16,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:16,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:16,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:16,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:16,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:16,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:16,695 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:16,695 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:16,696 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:16,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:16,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:16,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:16,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:16,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:16,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:16,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:16,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:16,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:16,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:16,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:16,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:16,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:16,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:16,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:16,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:16,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:16,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:16,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:16,708 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:16,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:16,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:16,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:16,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:16,711 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:16,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:16,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:16,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:16,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:16,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:16,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:16,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:16,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:16,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:16,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:16,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:16,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:16,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:16,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:16,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:16,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:16,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:16,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:16,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:16,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:16,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:16,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:16,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:16,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:16,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:16,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:16,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:16,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:16,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:16,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:16,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:16,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:16,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:16,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:16,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:16,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:16,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:16,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:16,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:16,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:16,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:16,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:16,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:16,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:16,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:16,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:16,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:16,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:16,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:16,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:16,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:16,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:16,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:16,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:16,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:16,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:16,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:16,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:16,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:16,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:16,748 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:16,748 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:16,749 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:16,750 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:16,750 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:16,751 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:16,751 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:16,752 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:16,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:16,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:16,754 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:16,754 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:16,755 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:16,756 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:16,756 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:16,757 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:16,757 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:16,758 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:16,758 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:16,759 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:16,759 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:16,760 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:16,761 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:16,761 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:16,762 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:16,780 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:16,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:16,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:16,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:16,827 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:16,829 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'
2015-02-10 19:08:16,851 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:16,856 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:16,857 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:16,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:16,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:16,887 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:16,887 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-10 19:08:16,887 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:16,888 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:16,888 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:16,888 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_RESULTS
2015-02-10 19:08:16,891 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:16,892 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:16,927 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:16,928 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:16,954 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:16,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:16,968 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:16,969 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:16,969 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:16,969 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:16,970 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:16,970 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:16,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:16,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:16,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:16,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:17,030 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1134177029_0003
2015-02-10 19:08:17,054 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1134177029/.staging/job_local1134177029_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:17,059 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1134177029/.staging/job_local1134177029_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:17,139 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1134177029_0003/job_local1134177029_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:17,140 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1134177029_0003/job_local1134177029_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:17,141 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:17,142 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1134177029_0003
2015-02-10 19:08:17,142 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:17,143 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:17,143 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:17,148 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:17,148 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1134177029_0003_m_000000_0
2015-02-10 19:08:17,151 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:17,154 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:17,155 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@553abee1
2015-02-10 19:08:17,157 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:17,158 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:17,303 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:17,304 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:17,305 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:17,305 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:17,306 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:17,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:17,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:17,319 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:17,319 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:17,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:17,324 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:17,325 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:17,325 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:17,326 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:17,332 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:17,335 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1134177029_0003_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:17,338 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:17,338 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1134177029_0003_m_000000_0' done.
2015-02-10 19:08:17,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1134177029_0003_m_000000_0
2015-02-10 19:08:17,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:17,346 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:17,348 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:17,348 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:17,349 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:17,349 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:17,350 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:17,360 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:17,361 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-10 19:08:17,377 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1134177029_0003_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:17,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:17,379 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1134177029_0003_r_000000_0 is allowed to commit now
2015-02-10 19:08:17,380 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1134177029_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary/0/task_local1134177029_0003_r_000000
2015-02-10 19:08:17,381 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:17,381 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1134177029_0003_r_000000_0' done.
2015-02-10 19:08:17,408 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary
2015-02-10 19:08:17,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:17,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:17,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:17,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:17,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:17,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:17,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:17,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:17,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:17,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:17,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:17,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:17,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:17,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:17,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:17,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:17,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:17,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:17,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:17,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:17,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:17,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:17,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:17,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:17,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:17,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:17,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:17,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:17,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:17,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:17,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:17,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:17,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:17,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:17,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:17,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:17,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:17,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:17,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:17,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:17,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:17,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:17,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:17,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:17,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:17,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:17,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:17,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:17,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:17,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:17,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:17,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:17,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:17,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:17,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:17,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:17,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:17,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:17,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:17,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:17,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:17,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:17,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:17,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:17,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:17,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:17,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:17,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:17,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:17,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:17,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:17,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:17,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:17,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:17,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:17,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:17,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:17,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:17,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:17,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:17,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:17,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:17,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:17,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:17,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:17,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:17,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:17,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:17,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:17,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:17,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:17,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:17,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:17,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:17,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:17,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:17,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:17,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:17,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:17,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:17,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:17,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:17,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:17,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:17,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:17,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:17,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:17,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:17,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:17,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:17,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:17,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:17,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:17,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:17,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:17,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:17,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:17,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:17,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:17,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:17,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:17,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:17,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:17,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:17,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:17,474 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:17,496 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:17,497 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:17,498 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:17,516 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:17,518 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS
2015-02-10 19:08:17,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:17,544 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:17,544 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:17,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:17,574 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:17,574 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:17,574 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-10 19:08:17,575 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:17,575 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:17,575 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:17,576 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_'field'_ALL
2015-02-10 19:08:17,577 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:17,578 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:17,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:17,624 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:17,679 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:17,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:17,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:17,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:17,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:17,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:17,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:17,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:17,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:17,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:17,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:17,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:17,702 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1912433536_0004
2015-02-10 19:08:17,726 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1912433536/.staging/job_local1912433536_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:17,730 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1912433536/.staging/job_local1912433536_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:17,785 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1912433536_0004/job_local1912433536_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:17,786 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1912433536_0004/job_local1912433536_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:17,787 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:17,788 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:17,789 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:17,789 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1912433536_0004
2015-02-10 19:08:17,789 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:17,793 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:17,793 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1912433536_0004_m_000000_0
2015-02-10 19:08:17,796 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:17,800 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:17,800 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1c8825a5
2015-02-10 19:08:17,803 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:17,803 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:17,970 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:17,970 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:17,970 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:17,970 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:17,970 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:17,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:17,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:17,982 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:17,982 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:17,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:17,986 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:17,986 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:17,987 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:17,987 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:17,991 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:17,994 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1912433536_0004_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:17,997 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:17,997 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1912433536_0004_m_000000_0' done.
2015-02-10 19:08:17,997 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1912433536_0004_m_000000_0
2015-02-10 19:08:17,998 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:18,004 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:18,005 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:18,006 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:18,006 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:18,007 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:18,007 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:18,015 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:18,015 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-10 19:08:18,031 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1912433536_0004_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:18,032 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:18,033 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1912433536_0004_r_000000_0 is allowed to commit now
2015-02-10 19:08:18,033 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1912433536_0004_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary/0/task_local1912433536_0004_r_000000
2015-02-10 19:08:18,035 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:18,035 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1912433536_0004_r_000000_0' done.
2015-02-10 19:08:18,063 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary
2015-02-10 19:08:18,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:18,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:18,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:18,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:18,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:18,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:18,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:18,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:18,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:18,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:18,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:18,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:18,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:18,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:18,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:18,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:18,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:18,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:18,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:18,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:18,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:18,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:18,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:18,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:18,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:18,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:18,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:18,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:18,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:18,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:18,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:18,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:18,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:18,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:18,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:18,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:18,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:18,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:18,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:18,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:18,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:18,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:18,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:18,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:18,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:18,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:18,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:18,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:18,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:18,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:18,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:18,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:18,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:18,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:18,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:18,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:18,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:18,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:18,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:18,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:18,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:18,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:18,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:18,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:18,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:18,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:18,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:18,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:18,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:18,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:18,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:18,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:18,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:18,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:18,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:18,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:18,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:18,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:18,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:18,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:18,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:18,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:18,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:18,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:18,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:18,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:18,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:18,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:18,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:18,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:18,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:18,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:18,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:18,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:18,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:18,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:18,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:18,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:18,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:18,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:18,107 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:18,107 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:18,107 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:18,107 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:18,108 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:18,108 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:18,108 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:18,108 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:18,109 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:18,109 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:18,109 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:18,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:18,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:18,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:18,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:18,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:18,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:18,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:18,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:18,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:18,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:18,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:18,113 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:18,113 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:18,129 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:18,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:18,149 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:18,164 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:18,166 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL
2015-02-10 19:08:18,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,190 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:18,190 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:18,203 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_REPLACE
2015-02-10 19:08:18,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,226 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:18,226 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:18,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:18,251 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:18,252 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:18,252 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-10 19:08:18,253 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:18,253 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:18,253 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:18,254 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_'field'_SWAP
2015-02-10 19:08:18,255 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:18,257 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:18,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:18,288 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:18,311 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:18,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:18,334 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:18,334 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:18,335 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:18,335 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:18,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:18,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:18,337 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:18,337 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:18,338 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:18,339 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:18,347 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1781589884_0005
2015-02-10 19:08:18,369 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1781589884/.staging/job_local1781589884_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:18,373 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1781589884/.staging/job_local1781589884_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:18,426 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1781589884_0005/job_local1781589884_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:18,427 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1781589884_0005/job_local1781589884_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:18,428 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:18,428 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1781589884_0005
2015-02-10 19:08:18,429 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:18,431 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:18,431 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:18,436 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:18,436 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1781589884_0005_m_000000_0
2015-02-10 19:08:18,439 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:18,441 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:18,441 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1c52ac68
2015-02-10 19:08:18,443 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:18,443 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:18,594 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:18,594 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:18,595 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:18,595 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:18,595 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:18,597 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:18,598 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:18,607 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:18,607 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:18,611 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:18,612 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:18,612 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:18,613 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:18,613 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:18,617 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:18,620 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1781589884_0005_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:18,623 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:18,623 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1781589884_0005_m_000000_0' done.
2015-02-10 19:08:18,624 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1781589884_0005_m_000000_0
2015-02-10 19:08:18,624 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:18,631 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:18,632 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:18,632 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:18,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:18,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:18,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:18,642 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:18,643 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-10 19:08:18,658 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1781589884_0005_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:18,660 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:18,660 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1781589884_0005_r_000000_0 is allowed to commit now
2015-02-10 19:08:18,661 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1781589884_0005_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary/0/task_local1781589884_0005_r_000000
2015-02-10 19:08:18,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:18,662 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1781589884_0005_r_000000_0' done.
2015-02-10 19:08:18,684 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary
2015-02-10 19:08:18,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:18,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:18,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:18,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:18,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:18,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:18,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:18,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:18,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:18,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:18,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:18,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:18,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:18,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:18,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:18,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:18,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:18,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:18,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:18,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:18,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:18,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:18,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:18,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:18,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:18,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:18,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:18,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:18,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:18,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:18,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:18,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:18,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:18,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:18,708 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:18,708 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:18,708 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:18,708 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:18,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:18,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:18,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:18,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:18,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:18,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:18,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:18,711 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:18,711 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:18,711 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:18,711 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:18,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:18,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:18,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:18,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:18,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:18,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:18,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:18,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:18,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:18,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:18,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:18,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:18,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:18,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:18,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:18,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:18,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:18,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:18,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:18,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:18,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:18,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:18,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:18,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:18,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:18,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:18,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:18,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:18,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:18,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:18,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:18,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:18,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:18,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:18,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:18,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:18,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:18,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:18,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:18,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:18,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:18,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:18,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:18,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:18,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:18,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:18,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:18,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:18,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:18,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:18,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:18,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:18,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:18,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:18,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:18,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:18,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:18,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:18,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:18,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:18,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:18,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:18,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:18,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:18,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:18,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:18,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:18,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:18,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:18,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:18,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:18,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:18,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:18,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:18,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:18,746 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:18,764 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,765 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:18,766 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:18,782 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:18,784 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP
2015-02-10 19:08:18,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:18,803 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:18,803 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:18,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:18,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:18,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:18,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-10 19:08:18,825 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:18,825 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:18,826 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:18,827 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_UNKNOWN_-1
2015-02-10 19:08:18,828 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:18,829 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:18,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:18,859 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:18,880 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:18,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:18,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:18,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:18,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:18,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:18,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:18,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:18,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:18,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:18,894 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:18,894 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:18,902 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local2101602073_0006
2015-02-10 19:08:18,924 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity2101602073/.staging/job_local2101602073_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:18,925 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity2101602073/.staging/job_local2101602073_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:19,281 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2101602073_0006/job_local2101602073_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:19,282 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2101602073_0006/job_local2101602073_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:19,283 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:19,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:19,284 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:19,283 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2101602073_0006
2015-02-10 19:08:19,284 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:19,287 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:19,287 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local2101602073_0006_m_000000_0
2015-02-10 19:08:19,290 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:19,292 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:19,292 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@33a17727
2015-02-10 19:08:19,294 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:19,295 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:19,370 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:19,371 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:19,371 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:19,371 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:19,372 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:19,374 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:19,374 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:19,383 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:19,383 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:19,387 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:19,387 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:19,387 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:19,388 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:19,388 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:19,392 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:19,394 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2101602073_0006_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:19,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:19,397 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2101602073_0006_m_000000_0' done.
2015-02-10 19:08:19,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local2101602073_0006_m_000000_0
2015-02-10 19:08:19,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:19,403 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:19,404 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:19,405 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:19,405 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:19,406 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:19,406 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:19,414 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:19,414 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-10 19:08:19,428 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2101602073_0006_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:19,430 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:19,430 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local2101602073_0006_r_000000_0 is allowed to commit now
2015-02-10 19:08:19,431 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2101602073_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary/0/task_local2101602073_0006_r_000000
2015-02-10 19:08:19,432 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:19,432 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2101602073_0006_r_000000_0' done.
2015-02-10 19:08:19,455 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary
2015-02-10 19:08:19,470 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:19,471 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:19,471 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:19,471 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:19,472 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:19,472 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:19,472 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:19,473 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:19,473 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:19,474 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:19,474 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:19,475 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:19,475 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:19,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:19,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:19,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:19,477 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:19,477 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:19,478 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:19,478 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:19,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:19,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:19,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:19,480 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:19,480 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:19,481 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:19,481 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:19,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:19,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:19,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:19,483 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:19,483 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:19,484 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:19,484 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:19,485 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:19,485 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:19,485 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:19,486 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:19,486 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:19,487 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:19,487 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:19,487 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:19,488 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:19,488 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:19,489 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:19,489 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:19,490 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:19,490 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:19,490 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:19,491 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:19,491 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:19,492 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:19,492 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:19,493 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:19,493 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:19,493 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:19,494 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:19,494 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:19,495 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:19,495 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:19,495 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:19,496 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:19,496 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:19,497 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:19,497 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:19,498 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:19,498 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:19,498 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:19,499 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:19,499 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:19,500 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:19,500 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:19,501 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:19,501 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:19,501 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:19,502 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:19,502 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:19,503 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:19,503 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:19,504 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:19,504 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:19,504 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:19,505 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:19,505 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:19,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:19,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:19,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:19,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:19,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:19,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:19,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:19,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:19,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:19,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:19,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:19,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:19,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:19,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:19,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:19,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:19,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:19,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:19,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:19,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:19,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:19,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:19,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:19,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:19,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:19,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:19,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:19,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:19,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:19,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:19,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:19,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:19,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:19,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:19,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:19,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:19,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:19,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:19,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:19,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:19,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:19,539 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:19,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:19,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:19,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:19,575 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:19,576 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1
2015-02-10 19:08:19,592 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:19,594 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:19,595 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:19,606 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_'field'
2015-02-10 19:08:19,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:19,627 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:19,628 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:19,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:19,648 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:19,648 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:19,649 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-10 19:08:19,649 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:19,649 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:19,649 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:19,649 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_RESULTS
2015-02-10 19:08:19,650 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:19,652 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:19,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:19,679 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:19,700 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:19,711 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:19,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:19,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:19,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:19,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:19,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:19,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:19,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:19,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:19,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:19,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:19,722 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local756125961_0007
2015-02-10 19:08:19,742 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity756125961/.staging/job_local756125961_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:19,745 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity756125961/.staging/job_local756125961_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:19,796 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local756125961_0007/job_local756125961_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:19,797 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local756125961_0007/job_local756125961_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:19,798 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:19,798 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local756125961_0007
2015-02-10 19:08:19,798 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:19,799 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:19,799 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:19,802 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:19,803 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local756125961_0007_m_000000_0
2015-02-10 19:08:19,805 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:19,807 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:19,807 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@74bc2f47
2015-02-10 19:08:19,809 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:19,809 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:19,969 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:19,970 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:19,970 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:19,971 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:19,971 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:19,972 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:19,973 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:19,981 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:19,981 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:19,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:19,986 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:19,986 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:19,987 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:19,987 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:19,991 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:19,994 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local756125961_0007_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:19,996 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:19,997 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local756125961_0007_m_000000_0' done.
2015-02-10 19:08:19,997 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local756125961_0007_m_000000_0
2015-02-10 19:08:19,998 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:20,004 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:20,005 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:20,006 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:20,006 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:20,007 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:20,007 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:20,015 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:20,015 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-10 19:08:20,035 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local756125961_0007_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:20,036 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:20,037 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local756125961_0007_r_000000_0 is allowed to commit now
2015-02-10 19:08:20,038 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local756125961_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary/0/task_local756125961_0007_r_000000
2015-02-10 19:08:20,039 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:20,039 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local756125961_0007_r_000000_0' done.
2015-02-10 19:08:20,061 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary
2015-02-10 19:08:20,075 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:20,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:20,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:20,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:20,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:20,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:20,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:20,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:20,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:20,077 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:20,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:20,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:20,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:20,078 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:20,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:20,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:20,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:20,079 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:20,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:20,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:20,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:20,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:20,080 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:20,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:20,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:20,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:20,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:20,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:20,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:20,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:20,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:20,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:20,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:20,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:20,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:20,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:20,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:20,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:20,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:20,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:20,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:20,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:20,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:20,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:20,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:20,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:20,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:20,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:20,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:20,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:20,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:20,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:20,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:20,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:20,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:20,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:20,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:20,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:20,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:20,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:20,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:20,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:20,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:20,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:20,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:20,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:20,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:20,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:20,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:20,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:20,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:20,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:20,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:20,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:20,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:20,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:20,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:20,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:20,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:20,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:20,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:20,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:20,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:20,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:20,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:20,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:20,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:20,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:20,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:20,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:20,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:20,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:20,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:20,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:20,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:20,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:20,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:20,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:20,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:20,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:20,100 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:20,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:20,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:20,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:20,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:20,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:20,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:20,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:20,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:20,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:20,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:20,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:20,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:20,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:20,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:20,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:20,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:20,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:20,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:20,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:20,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:20,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:20,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:20,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:20,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:20,122 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:20,141 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:20,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:20,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:20,161 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:20,163 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS
2015-02-10 19:08:20,179 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:20,180 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:20,181 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:20,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:20,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:20,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:20,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-10 19:08:20,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:20,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:20,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:20,201 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_UNKNOWN_ALL
2015-02-10 19:08:20,201 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:20,202 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:20,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:20,230 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:20,251 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:20,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:20,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:20,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:20,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:20,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:20,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:20,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:20,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:20,264 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:20,264 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:20,264 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:20,270 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local475975056_0008
2015-02-10 19:08:20,288 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity475975056/.staging/job_local475975056_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:20,291 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity475975056/.staging/job_local475975056_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:20,340 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local475975056_0008/job_local475975056_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:20,341 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local475975056_0008/job_local475975056_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:20,342 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:20,342 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local475975056_0008
2015-02-10 19:08:20,342 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:20,342 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:20,343 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:20,346 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:20,346 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local475975056_0008_m_000000_0
2015-02-10 19:08:20,349 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:20,351 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:20,351 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7a8f6d64
2015-02-10 19:08:20,353 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:20,354 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:20,516 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:20,517 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:20,517 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:20,517 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:20,517 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:20,519 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:20,519 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:20,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:20,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:20,532 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:20,532 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:20,532 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:20,532 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:20,533 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:20,537 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:20,539 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local475975056_0008_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:20,542 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:20,542 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local475975056_0008_m_000000_0' done.
2015-02-10 19:08:20,542 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local475975056_0008_m_000000_0
2015-02-10 19:08:20,543 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:20,549 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:20,550 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:20,550 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:20,551 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:20,551 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:20,551 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:20,558 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:20,558 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-10 19:08:20,574 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local475975056_0008_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:20,576 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:20,576 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local475975056_0008_r_000000_0 is allowed to commit now
2015-02-10 19:08:20,577 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local475975056_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary/0/task_local475975056_0008_r_000000
2015-02-10 19:08:20,578 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:20,578 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local475975056_0008_r_000000_0' done.
2015-02-10 19:08:20,605 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary
2015-02-10 19:08:20,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:20,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:20,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:20,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:20,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:20,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:20,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:20,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:20,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:20,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:20,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:20,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:20,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:20,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:20,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:20,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:20,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:20,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:20,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:20,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:20,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:20,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:20,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:20,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:20,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:20,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:20,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:20,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:20,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:20,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:20,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:20,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:20,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:20,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:20,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:20,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:20,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:20,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:20,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:20,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:20,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:20,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:20,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:20,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:20,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:20,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:20,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:20,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:20,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:20,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:20,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:20,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:20,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:20,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:20,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:20,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:20,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:20,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:20,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:20,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:20,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:20,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:20,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:20,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:20,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:20,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:20,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:20,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:20,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:20,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:20,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:20,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:20,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:20,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:20,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:20,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:20,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:20,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:20,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:20,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:20,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:20,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:20,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:20,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:20,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:20,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:20,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:20,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:20,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:20,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:20,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:20,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:20,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:20,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:20,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:20,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:20,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:20,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:20,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:20,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:20,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:20,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:20,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:20,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:20,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:20,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:20,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:20,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:20,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:20,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:20,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:20,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:20,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:20,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:20,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:20,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:20,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:20,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:20,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:20,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:20,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:20,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:20,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:20,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:20,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:20,663 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:20,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:20,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:20,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:20,698 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:20,700 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL
2015-02-10 19:08:20,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:20,722 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:20,723 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:20,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:20,742 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:20,742 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:20,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-10 19:08:20,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:20,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:20,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:20,745 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-10 19:08:20,746 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:20,748 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:20,776 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:20,778 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:20,801 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:20,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:20,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:20,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:20,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:20,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:20,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:20,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:20,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:20,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:20,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:20,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:20,831 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1793936638_0009
2015-02-10 19:08:20,852 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1793936638/.staging/job_local1793936638_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:20,855 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1793936638/.staging/job_local1793936638_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:20,909 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1793936638_0009/job_local1793936638_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:20,910 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1793936638_0009/job_local1793936638_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:20,911 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:20,912 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1793936638_0009
2015-02-10 19:08:20,912 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:20,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:20,913 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:20,916 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:20,917 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1793936638_0009_m_000000_0
2015-02-10 19:08:20,919 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:20,920 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:20,921 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2c4120aa
2015-02-10 19:08:20,922 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:20,922 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:21,072 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:21,073 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:21,073 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:21,073 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:21,073 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:21,074 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:21,074 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:21,081 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:21,082 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:21,086 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:21,086 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:21,086 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:21,086 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:21,086 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:21,090 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:21,093 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1793936638_0009_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:21,095 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:21,095 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1793936638_0009_m_000000_0' done.
2015-02-10 19:08:21,095 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1793936638_0009_m_000000_0
2015-02-10 19:08:21,095 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:21,101 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:21,102 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:21,102 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:21,103 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:21,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:21,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:21,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:21,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-10 19:08:21,121 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:21,125 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1793936638_0009
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:21,127 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1793936638_0009 state at FAILED
2015-02-10 19:08:21,127 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:21,128 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:21,129 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:21,135 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:21,135 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-10 19:08:21,136 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:21,136 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE/_temporary
2015-02-10 19:08:21,137 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE
2015-02-10 19:08:21,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:21,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:21,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:21,154 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:21,155 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:21,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:21,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:21,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:21,171 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:21,171 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:21,172 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-10 19:08:21,172 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:21,172 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:21,173 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:21,174 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_UNKNOWN_SWAP
2015-02-10 19:08:21,175 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:21,176 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:21,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:21,202 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:21,223 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:21,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:21,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:21,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:21,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:21,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:21,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:21,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:21,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:21,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:21,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:21,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:21,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:21,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:21,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:21,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:21,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:21,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:21,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:21,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:21,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:21,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:21,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:21,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:21,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:21,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:21,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:21,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:21,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:21,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:21,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:21,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:21,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:21,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:21,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:21,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:21,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:21,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:21,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:21,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:21,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:21,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:21,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:21,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:21,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:21,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:21,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:21,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:21,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:21,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:21,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:21,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:21,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:21,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:21,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:21,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:21,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:21,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:21,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:21,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:21,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:21,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:21,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:21,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:21,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:21,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:21,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:21,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:21,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:21,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:21,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:21,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:21,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:21,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:21,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:21,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:21,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:21,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:21,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:21,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:21,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:21,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:21,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:21,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:21,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:21,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:21,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:21,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:21,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:21,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:21,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:21,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:21,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:21,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:21,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:21,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:21,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:21,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:21,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:21,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:21,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:21,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:21,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:21,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:21,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:21,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:21,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:21,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:21,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:21,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:21,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:21,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:21,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:21,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:21,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:21,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:21,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:21,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:21,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:21,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:21,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:21,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:21,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:21,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:21,262 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1380354513_0010
2015-02-10 19:08:21,280 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1380354513/.staging/job_local1380354513_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:21,281 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1380354513/.staging/job_local1380354513_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:21,335 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1380354513_0010/job_local1380354513_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:21,335 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1380354513_0010/job_local1380354513_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:21,336 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:21,337 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1380354513_0010
2015-02-10 19:08:21,337 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:21,337 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:21,337 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:21,340 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:21,340 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1380354513_0010_m_000000_0
2015-02-10 19:08:21,343 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:21,345 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:21,345 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@24812051
2015-02-10 19:08:21,347 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:21,347 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:21,495 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:21,496 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:21,496 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:21,496 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:21,496 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:21,498 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:21,498 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:21,505 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:21,505 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:21,509 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:21,509 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:21,509 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:21,509 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:21,510 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:21,513 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:21,516 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1380354513_0010_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:21,518 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:21,518 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1380354513_0010_m_000000_0' done.
2015-02-10 19:08:21,518 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1380354513_0010_m_000000_0
2015-02-10 19:08:21,518 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:21,524 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:21,525 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:21,526 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:21,526 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:21,527 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:21,527 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:21,534 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:21,534 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-10 19:08:21,549 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1380354513_0010_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:21,550 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:21,551 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1380354513_0010_r_000000_0 is allowed to commit now
2015-02-10 19:08:21,552 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1380354513_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary/0/task_local1380354513_0010_r_000000
2015-02-10 19:08:21,553 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:21,553 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1380354513_0010_r_000000_0' done.
2015-02-10 19:08:21,577 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary
2015-02-10 19:08:21,592 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:21,592 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:21,593 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:21,593 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:21,593 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:21,593 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:21,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:21,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:21,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:21,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:21,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:21,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:21,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:21,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:21,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:21,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:21,596 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:21,596 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:21,596 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:21,596 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:21,597 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:21,597 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:21,597 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:21,597 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:21,597 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:21,598 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:21,598 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:21,598 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:21,598 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:21,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:21,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:21,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:21,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:21,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:21,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:21,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:21,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:21,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:21,601 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:21,601 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:21,601 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:21,601 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:21,602 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:21,602 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:21,602 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:21,602 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:21,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:21,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:21,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:21,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:21,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:21,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:21,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:21,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:21,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:21,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:21,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:21,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:21,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:21,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:21,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:21,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:21,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:21,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:21,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:21,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:21,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:21,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:21,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:21,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:21,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:21,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:21,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:21,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:21,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:21,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:21,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:21,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:21,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:21,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:21,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:21,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:21,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:21,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:21,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:21,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:21,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:21,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:21,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:21,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:21,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:21,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:21,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:21,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:21,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:21,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:21,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:21,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:21,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:21,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:21,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:21,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:21,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:21,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:21,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:21,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:21,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:21,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:21,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:21,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:21,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:21,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:21,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:21,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:21,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:21,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:21,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:21,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:21,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:21,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:21,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:21,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:21,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:21,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:21,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:21,638 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:21,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:21,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:21,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:21,672 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:21,673 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP
2015-02-10 19:08:21,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:21,695 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:21,695 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:21,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:21,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:21,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:21,714 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-10 19:08:21,714 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:21,714 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:21,714 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:21,715 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-10 19:08:21,715 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:21,717 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:21,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:21,742 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:21,762 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:22,062 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:22,062 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:22,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:22,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:22,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:22,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:22,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:22,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:22,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:22,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:22,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:22,070 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local2112608327_0011
2015-02-10 19:08:22,091 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity2112608327/.staging/job_local2112608327_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:22,095 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity2112608327/.staging/job_local2112608327_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:22,143 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2112608327_0011/job_local2112608327_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:22,143 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2112608327_0011/job_local2112608327_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:22,144 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:22,145 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2112608327_0011
2015-02-10 19:08:22,145 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:22,145 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:22,145 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:22,148 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:22,148 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local2112608327_0011_m_000000_0
2015-02-10 19:08:22,150 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:22,151 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:22,151 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7972d19e
2015-02-10 19:08:22,153 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:22,153 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:22,184 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:22,184 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:22,184 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:22,184 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:22,184 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:22,186 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:22,186 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:22,193 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:22,193 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:22,197 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:22,197 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:22,197 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:22,197 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:22,197 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:22,201 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:22,203 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2112608327_0011_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:22,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:22,205 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2112608327_0011_m_000000_0' done.
2015-02-10 19:08:22,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local2112608327_0011_m_000000_0
2015-02-10 19:08:22,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:22,211 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:22,211 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:22,212 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:22,212 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:22,213 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:22,213 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:22,219 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:22,219 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-10 19:08:22,228 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:22,231 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local2112608327_0011
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:22,237 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local2112608327_0011 state at FAILED
2015-02-10 19:08:22,237 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:22,237 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:22,237 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:22,243 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:22,244 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-10 19:08:22,244 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:22,245 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1/_temporary
2015-02-10 19:08:22,245 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1
2015-02-10 19:08:22,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:22,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:22,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:22,262 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:22,262 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:22,269 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_'field'
2015-02-10 19:08:22,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:22,285 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:22,285 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:22,293 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:22,295 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:22,296 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:22,300 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:22,301 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:22,301 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-10 19:08:22,302 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:22,303 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:22,303 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:22,304 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-10 19:08:22,305 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:22,306 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:22,331 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:22,332 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:22,352 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:22,362 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:22,362 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:22,363 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:22,363 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:22,363 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:22,363 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:22,363 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:22,363 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:22,364 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:22,364 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:22,364 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:22,364 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:22,364 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:22,364 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:22,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:22,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:22,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:22,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:22,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:22,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:22,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:22,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:22,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:22,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:22,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:22,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:22,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:22,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:22,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:22,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:22,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:22,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:22,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:22,369 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:22,369 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:22,369 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:22,369 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:22,369 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:22,369 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:22,370 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:22,370 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:22,370 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:22,370 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:22,370 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:22,370 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:22,371 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:22,371 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:22,371 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:22,371 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:22,371 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:22,371 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:22,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:22,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:22,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:22,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:22,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:22,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:22,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:22,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:22,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:22,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:22,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:22,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:22,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:22,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:22,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:22,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:22,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:22,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:22,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:22,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:22,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:22,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:22,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:22,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:22,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:22,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:22,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:22,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:22,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:22,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:22,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:22,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:22,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:22,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:22,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:22,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:22,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:22,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:22,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:22,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:22,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:22,379 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:22,379 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:22,379 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:22,379 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:22,379 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:22,379 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:22,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:22,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:22,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:22,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:22,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:22,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:22,381 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:22,381 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:22,381 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:22,381 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:22,381 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:22,381 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:22,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:22,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:22,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:22,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:22,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:22,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:22,383 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:22,383 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:22,383 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:22,383 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:22,383 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:22,383 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:22,384 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:22,389 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1709031754_0012
2015-02-10 19:08:22,409 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1709031754/.staging/job_local1709031754_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:22,410 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1709031754/.staging/job_local1709031754_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:22,456 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1709031754_0012/job_local1709031754_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:22,456 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1709031754_0012/job_local1709031754_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:22,457 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:22,457 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1709031754_0012
2015-02-10 19:08:22,457 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:22,458 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:22,458 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:22,462 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:22,462 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1709031754_0012_m_000000_0
2015-02-10 19:08:22,464 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:22,466 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:22,466 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5c3ba2b2
2015-02-10 19:08:22,468 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:22,468 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:22,617 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:22,617 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:22,617 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:22,618 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:22,618 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:22,620 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:22,620 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:22,627 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:22,627 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:22,632 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:22,632 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:22,632 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:22,632 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:22,632 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:22,680 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:22,682 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1709031754_0012_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:22,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:22,684 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1709031754_0012_m_000000_0' done.
2015-02-10 19:08:22,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1709031754_0012_m_000000_0
2015-02-10 19:08:22,685 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:22,690 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:22,691 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:22,692 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:22,692 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:22,693 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:22,693 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:22,699 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:22,700 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-10 19:08:22,709 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:22,712 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1709031754_0012
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:22,722 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1709031754_0012 state at FAILED
2015-02-10 19:08:22,722 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:22,722 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:22,723 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:22,729 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:22,729 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-10 19:08:22,729 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:22,730 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS/_temporary
2015-02-10 19:08:22,730 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS
2015-02-10 19:08:22,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:22,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:22,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:22,748 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:22,749 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:22,758 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:22,761 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:22,762 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:22,767 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:22,767 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:22,767 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-10 19:08:22,767 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:22,767 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:22,767 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:22,768 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-10 19:08:22,769 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:22,770 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:22,794 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:22,795 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:22,815 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:22,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:22,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:22,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:22,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:22,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:22,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:22,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:22,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:22,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:22,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:22,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:22,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:22,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:22,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:22,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:22,828 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:22,828 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:22,828 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:22,828 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:22,828 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:22,829 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:22,829 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:22,829 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:22,829 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:22,829 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:22,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:22,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:22,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:22,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:22,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:22,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:22,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:22,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:22,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:22,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:22,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:22,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:22,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:22,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:22,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:22,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:22,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:22,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:22,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:22,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:22,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:22,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:22,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:22,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:22,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:22,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:22,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:22,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:22,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:22,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:22,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:22,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:22,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:22,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:22,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:22,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:22,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:22,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:22,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:22,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:22,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:22,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:22,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:22,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:22,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:22,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:22,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:22,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:22,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:22,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:22,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:22,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:22,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:22,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:22,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:22,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:22,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:22,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:22,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:22,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:22,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:22,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:22,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:22,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:22,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:22,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:22,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:22,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:22,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:22,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:22,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:22,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:22,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:22,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:22,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:22,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:22,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:22,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:22,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:22,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:22,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:22,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:22,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:22,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:22,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:22,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:22,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:22,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:22,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:22,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:22,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:22,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:22,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:22,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:22,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:22,849 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:22,849 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:22,849 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:22,849 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:22,849 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:22,849 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:22,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:22,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:22,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:22,860 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local440420623_0013
2015-02-10 19:08:22,884 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity440420623/.staging/job_local440420623_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:22,887 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity440420623/.staging/job_local440420623_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:22,937 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local440420623_0013/job_local440420623_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:22,937 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local440420623_0013/job_local440420623_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:22,939 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:22,940 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:22,940 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:22,940 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local440420623_0013
2015-02-10 19:08:22,940 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:22,943 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:22,943 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local440420623_0013_m_000000_0
2015-02-10 19:08:22,945 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:22,946 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:22,946 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@149d7837
2015-02-10 19:08:22,947 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:22,948 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:23,094 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:23,094 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:23,094 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:23,094 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:23,094 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:23,096 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:23,096 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:23,103 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:23,103 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:23,107 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:23,107 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:23,107 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:23,107 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:23,108 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:23,111 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:23,113 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local440420623_0013_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:23,115 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:23,115 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local440420623_0013_m_000000_0' done.
2015-02-10 19:08:23,116 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local440420623_0013_m_000000_0
2015-02-10 19:08:23,116 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:23,121 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:23,122 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:23,122 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:23,123 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:23,123 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:23,123 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:23,130 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:23,130 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-10 19:08:23,139 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:23,144 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local440420623_0013
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:23,145 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local440420623_0013 state at FAILED
2015-02-10 19:08:23,147 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:23,147 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:23,147 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:23,153 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:23,154 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-10 19:08:23,154 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:23,154 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL/_temporary
2015-02-10 19:08:23,155 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL
2015-02-10 19:08:23,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:23,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:23,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:23,172 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:23,173 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:23,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:23,182 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:23,183 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:23,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:23,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:23,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-10 19:08:23,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:23,188 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:23,188 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:23,188 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-10 19:08:23,189 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:23,190 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:23,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:23,214 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:23,234 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:23,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:23,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:23,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:23,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:23,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:23,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:23,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:23,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:23,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:23,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:23,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:23,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:23,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:23,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:23,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:23,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:23,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:23,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:23,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:23,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:23,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:23,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:23,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:23,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:23,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:23,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:23,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:23,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:23,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:23,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:23,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:23,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:23,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:23,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:23,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:23,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:23,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:23,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:23,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:23,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:23,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:23,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:23,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:23,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:23,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:23,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:23,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:23,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:23,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:23,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:23,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:23,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:23,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:23,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:23,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:23,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:23,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:23,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:23,253 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:23,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:23,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:23,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:23,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:23,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:23,254 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:23,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:23,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:23,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:23,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:23,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:23,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:23,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:23,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:23,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:23,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:23,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:23,256 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:23,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:23,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:23,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:23,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:23,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:23,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:23,258 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:23,258 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:23,258 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:23,258 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:23,258 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:23,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:23,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:23,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:23,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:23,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:23,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:23,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:23,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:23,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:23,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:23,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:23,260 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:23,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:23,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:23,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:23,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:23,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:23,261 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:23,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:23,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:23,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:23,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:23,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:23,262 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:23,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:23,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:23,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:23,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:23,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:23,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:23,264 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:23,264 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:23,264 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:23,265 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:23,265 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:23,265 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:23,265 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:23,266 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:23,266 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:23,266 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:23,266 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:23,272 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local539766565_0014
2015-02-10 19:08:23,292 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity539766565/.staging/job_local539766565_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:23,293 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity539766565/.staging/job_local539766565_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:23,339 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local539766565_0014/job_local539766565_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:23,340 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local539766565_0014/job_local539766565_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:23,341 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:23,341 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local539766565_0014
2015-02-10 19:08:23,346 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:23,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:23,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:23,350 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:23,350 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local539766565_0014_m_000000_0
2015-02-10 19:08:23,352 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:23,353 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:23,353 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@a24d858
2015-02-10 19:08:23,355 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:23,355 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:23,505 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:23,505 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:23,505 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:23,505 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:23,505 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:23,509 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:23,509 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:23,517 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:23,517 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:23,521 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:23,521 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:23,521 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:23,521 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:23,522 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:23,525 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:23,527 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local539766565_0014_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:23,529 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:23,529 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local539766565_0014_m_000000_0' done.
2015-02-10 19:08:23,530 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local539766565_0014_m_000000_0
2015-02-10 19:08:23,530 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:23,535 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:23,536 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:23,536 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:23,537 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:23,538 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:23,538 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:23,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:23,545 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-10 19:08:23,554 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:23,557 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local539766565_0014
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:23,559 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local539766565_0014 state at FAILED
2015-02-10 19:08:23,560 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:23,560 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:23,560 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:23,566 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:23,566 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-10 19:08:23,567 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:23,567 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE/_temporary
2015-02-10 19:08:23,567 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE
2015-02-10 19:08:23,582 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:23,583 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:23,583 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:23,585 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:23,585 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:23,593 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:23,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:23,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:23,599 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:23,600 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:23,600 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-10 19:08:23,600 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:23,601 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:23,601 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:23,602 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-10 19:08:23,602 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:23,603 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:23,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:23,628 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:23,648 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:23,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:23,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:23,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:23,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:23,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:23,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:23,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:23,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:23,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:23,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:23,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:23,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:23,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:23,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:23,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:23,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:23,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:23,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:23,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:23,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:23,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:23,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:23,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:23,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:23,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:23,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:23,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:23,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:23,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:23,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:23,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:23,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:23,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:23,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:23,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:23,665 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:23,665 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:23,665 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:23,666 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:23,666 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:23,666 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:23,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:23,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:23,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:23,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:23,668 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:23,668 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:23,668 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:23,669 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:23,669 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:23,669 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:23,670 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:23,670 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:23,670 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:23,671 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:23,671 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:23,671 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:23,672 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:23,672 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:23,672 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:23,673 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:23,673 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:23,673 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:23,674 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:23,674 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:23,674 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:23,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:23,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:23,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:23,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:23,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:23,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:23,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:23,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:23,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:23,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:23,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:23,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:23,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:23,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:23,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:23,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:23,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:23,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:23,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:23,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:23,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:23,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:23,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:23,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:23,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:23,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:23,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:23,684 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:23,684 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:23,684 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:23,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:23,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:23,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:23,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:23,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:23,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:23,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:23,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:23,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:23,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:23,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:23,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:23,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:23,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:23,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:23,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:23,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:23,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:23,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:23,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:23,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:23,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:23,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:23,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:23,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:23,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:23,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:23,699 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local789675024_0015
2015-02-10 19:08:23,718 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity789675024/.staging/job_local789675024_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:23,719 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity789675024/.staging/job_local789675024_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:23,778 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local789675024_0015/job_local789675024_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:23,779 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local789675024_0015/job_local789675024_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:23,780 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:23,780 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local789675024_0015
2015-02-10 19:08:23,781 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:23,781 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:23,781 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:23,785 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:23,785 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local789675024_0015_m_000000_0
2015-02-10 19:08:23,787 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:23,789 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:23,789 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@425a649
2015-02-10 19:08:23,791 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:23,791 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:24,053 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:24,053 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:24,053 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:24,053 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:24,054 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:24,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:24,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:24,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:24,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:24,066 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:24,066 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:24,066 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:24,066 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:24,067 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:24,070 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:24,072 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local789675024_0015_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:24,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:24,074 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local789675024_0015_m_000000_0' done.
2015-02-10 19:08:24,074 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local789675024_0015_m_000000_0
2015-02-10 19:08:24,074 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:24,079 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:24,079 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:24,080 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:24,080 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:24,081 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:24,081 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:24,087 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:24,087 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-10 19:08:24,096 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:24,098 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local789675024_0015
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:24,100 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local789675024_0015 state at FAILED
2015-02-10 19:08:24,100 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:24,101 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:24,101 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:24,108 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:24,108 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-10 19:08:24,109 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:24,109 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP/_temporary
2015-02-10 19:08:24,110 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP
2015-02-10 19:08:24,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:24,125 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:24,125 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:24,127 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:24,127 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:24,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:24,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:24,139 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:24,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:24,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:24,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-10 19:08:24,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:24,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:24,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:24,144 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...semblyplatform/-1_ARGS_-1
2015-02-10 19:08:24,145 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:24,148 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:24,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:24,172 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:24,190 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:24,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:24,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:24,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:24,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:24,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:24,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:24,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:24,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:24,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:24,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:24,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:24,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:24,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:24,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:24,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:24,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:24,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:24,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:24,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:24,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:24,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:24,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:24,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:24,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:24,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:24,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:24,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:24,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:24,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:24,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:24,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:24,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:24,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:24,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:24,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:24,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:24,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:24,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:24,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:24,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:24,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:24,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:24,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:24,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:24,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:24,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:24,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:24,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:24,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:24,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:24,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:24,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:24,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:24,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:24,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:24,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:24,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:24,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:24,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:24,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:24,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:24,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:24,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:24,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:24,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:24,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:24,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:24,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:24,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:24,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:24,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:24,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:24,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:24,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:24,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:24,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:24,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:24,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:24,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:24,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:24,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:24,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:24,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:24,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:24,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:24,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:24,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:24,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:24,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:24,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:24,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:24,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:24,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:24,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:24,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:24,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:24,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:24,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:24,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:24,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:24,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:24,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:24,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:24,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:24,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:24,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:24,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:24,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:24,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:24,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:24,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:24,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:24,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:24,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:24,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:24,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:24,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:24,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:24,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:24,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:24,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:24,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:24,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:24,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:24,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:24,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:24,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:24,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:24,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:24,236 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local535725163_0016
2015-02-10 19:08:24,253 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity535725163/.staging/job_local535725163_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:24,256 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity535725163/.staging/job_local535725163_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:24,303 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local535725163_0016/job_local535725163_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:24,304 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local535725163_0016/job_local535725163_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:24,305 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:24,306 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local535725163_0016
2015-02-10 19:08:24,306 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:24,306 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:24,307 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:24,309 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:24,310 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local535725163_0016_m_000000_0
2015-02-10 19:08:24,311 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:24,313 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:24,314 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@e046ccf
2015-02-10 19:08:24,315 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:24,315 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:24,476 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:24,477 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:24,477 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:24,477 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:24,477 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:24,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:24,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:24,486 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:24,486 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:24,490 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:24,490 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:24,490 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:24,490 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:24,490 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:24,494 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:24,496 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local535725163_0016_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:24,497 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:24,498 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local535725163_0016_m_000000_0' done.
2015-02-10 19:08:24,498 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local535725163_0016_m_000000_0
2015-02-10 19:08:24,498 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:24,502 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:24,503 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:24,504 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:24,504 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:24,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:24,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:24,511 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:24,511 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-10 19:08:24,527 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local535725163_0016_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:24,528 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:24,528 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local535725163_0016_r_000000_0 is allowed to commit now
2015-02-10 19:08:24,529 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local535725163_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary/0/task_local535725163_0016_r_000000
2015-02-10 19:08:24,530 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:24,530 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local535725163_0016_r_000000_0' done.
2015-02-10 19:08:24,546 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary
2015-02-10 19:08:24,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:24,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:24,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:24,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:24,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:24,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:24,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:24,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:24,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:24,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:24,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:24,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:24,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:24,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:24,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:24,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:24,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:24,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:24,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:24,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:24,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:24,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:24,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:24,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:24,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:24,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:24,566 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:24,566 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:24,566 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:24,566 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:24,567 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:24,567 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:24,567 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:24,567 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:24,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:24,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:24,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:24,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:24,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:24,569 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:24,569 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:24,569 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:24,569 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:24,570 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:24,570 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:24,570 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:24,570 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:24,571 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:24,571 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:24,571 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:24,571 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:24,571 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:24,572 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:24,572 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:24,572 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:24,572 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:24,573 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:24,573 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:24,573 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:24,573 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:24,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:24,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:24,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:24,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:24,575 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:24,575 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:24,575 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:24,575 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:24,576 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:24,576 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:24,576 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:24,577 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:24,577 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:24,577 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:24,577 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:24,577 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:24,578 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:24,578 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:24,578 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:24,578 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:24,579 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:24,579 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:24,579 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:24,579 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:24,580 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:24,580 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:24,580 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:24,580 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:24,580 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:24,581 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:24,581 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:24,581 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:24,581 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:24,582 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:24,582 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:24,582 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:24,582 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:24,582 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:24,583 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:24,583 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:24,583 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:24,583 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:24,584 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:24,584 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:24,584 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:24,584 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:24,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:24,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:24,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:24,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:24,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:24,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:24,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:24,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:24,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:24,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:24,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:24,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:24,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:24,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:24,588 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:24,588 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:24,588 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:24,588 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:24,589 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:24,603 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:24,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:24,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:24,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:24,634 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:24,635 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1
2015-02-10 19:08:24,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:24,651 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:24,651 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:24,659 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_'field'
2015-02-10 19:08:24,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:24,677 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:24,678 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:24,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:24,692 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:24,692 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:24,692 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-10 19:08:24,692 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:24,692 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:24,693 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:24,693 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_RESULTS
2015-02-10 19:08:24,694 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:24,697 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:24,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:24,721 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:24,741 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:24,751 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:24,751 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:24,752 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:24,752 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:24,752 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:24,752 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:24,752 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:24,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:24,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:24,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:24,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:24,759 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1123177570_0017
2015-02-10 19:08:24,775 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1123177570/.staging/job_local1123177570_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:24,776 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1123177570/.staging/job_local1123177570_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:24,822 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1123177570_0017/job_local1123177570_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:24,822 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1123177570_0017/job_local1123177570_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:24,824 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:24,824 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1123177570_0017
2015-02-10 19:08:24,824 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:24,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:24,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:24,828 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:24,828 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1123177570_0017_m_000000_0
2015-02-10 19:08:24,832 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:24,834 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:24,834 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@516b9e1
2015-02-10 19:08:24,836 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:24,836 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:25,009 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:25,009 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:25,009 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:25,009 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:25,009 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:25,012 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:25,012 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:25,020 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:25,020 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:25,024 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,024 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:25,024 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:25,024 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:25,025 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:25,028 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:25,031 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1123177570_0017_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:25,034 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:25,034 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1123177570_0017_m_000000_0' done.
2015-02-10 19:08:25,034 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1123177570_0017_m_000000_0
2015-02-10 19:08:25,034 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:25,039 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:25,040 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:25,041 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:25,041 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,042 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:25,042 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:25,048 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:25,049 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-10 19:08:25,062 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1123177570_0017_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:25,064 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,064 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1123177570_0017_r_000000_0 is allowed to commit now
2015-02-10 19:08:25,065 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1123177570_0017_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary/0/task_local1123177570_0017_r_000000
2015-02-10 19:08:25,066 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:25,066 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1123177570_0017_r_000000_0' done.
2015-02-10 19:08:25,085 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary
2015-02-10 19:08:25,109 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:25,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:25,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:25,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:25,110 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:25,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:25,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:25,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:25,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:25,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:25,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:25,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:25,113 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:25,113 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:25,113 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:25,113 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:25,114 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:25,114 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:25,114 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:25,114 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:25,115 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:25,115 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:25,115 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:25,115 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:25,116 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:25,116 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:25,116 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:25,117 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:25,117 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:25,117 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:25,117 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,118 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:25,118 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:25,118 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:25,118 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:25,119 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:25,119 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:25,119 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:25,119 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:25,120 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:25,120 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:25,120 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:25,121 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:25,121 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:25,121 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:25,121 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:25,122 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:25,122 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:25,122 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:25,123 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:25,123 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:25,123 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:25,123 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:25,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:25,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:25,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:25,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:25,125 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:25,125 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:25,125 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:25,125 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:25,126 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:25,126 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:25,126 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:25,127 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:25,127 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:25,127 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:25,127 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:25,128 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:25,128 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:25,128 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:25,128 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:25,129 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:25,129 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:25,129 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:25,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:25,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:25,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:25,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:25,131 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:25,131 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:25,131 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:25,132 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:25,132 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:25,132 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:25,133 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:25,133 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:25,133 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:25,134 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:25,134 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:25,134 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:25,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:25,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:25,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:25,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:25,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:25,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:25,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:25,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:25,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:25,139 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:25,139 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:25,140 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:25,140 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:25,140 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:25,141 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:25,141 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:25,141 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:25,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:25,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:25,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:25,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:25,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:25,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:25,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:25,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:25,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:25,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:25,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:25,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:25,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:25,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:25,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:25,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:25,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:25,163 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:25,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:25,182 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:25,195 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:25,197 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS
2015-02-10 19:08:25,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,213 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:25,213 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:25,218 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_ALL
2015-02-10 19:08:25,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,234 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:25,234 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:25,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:25,246 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:25,246 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:25,246 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-10 19:08:25,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:25,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:25,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:25,249 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_REPLACE
2015-02-10 19:08:25,249 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:25,250 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:25,273 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:25,274 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:25,294 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:25,303 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:25,304 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:25,304 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:25,304 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:25,304 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:25,304 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:25,305 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:25,305 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:25,305 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:25,305 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:25,305 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:25,311 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local227708258_0018
2015-02-10 19:08:25,328 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity227708258/.staging/job_local227708258_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:25,330 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity227708258/.staging/job_local227708258_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:25,373 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local227708258_0018/job_local227708258_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:25,373 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local227708258_0018/job_local227708258_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:25,374 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:25,374 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local227708258_0018
2015-02-10 19:08:25,375 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:25,375 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:25,375 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:25,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:25,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local227708258_0018_m_000000_0
2015-02-10 19:08:25,380 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:25,381 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:25,381 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4f1a20af
2015-02-10 19:08:25,383 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:25,383 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:25,551 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:25,551 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:25,552 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:25,552 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:25,552 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:25,553 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:25,553 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:25,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:25,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:25,564 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,564 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:25,564 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:25,564 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:25,565 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:25,568 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:25,570 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local227708258_0018_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:25,571 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:25,572 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local227708258_0018_m_000000_0' done.
2015-02-10 19:08:25,572 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local227708258_0018_m_000000_0
2015-02-10 19:08:25,572 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:25,576 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:25,577 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:25,578 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:25,578 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,578 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:25,579 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:25,585 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:25,585 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-10 19:08:25,597 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local227708258_0018_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:25,598 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,598 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local227708258_0018_r_000000_0 is allowed to commit now
2015-02-10 19:08:25,599 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local227708258_0018_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary/0/task_local227708258_0018_r_000000
2015-02-10 19:08:25,600 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:25,600 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local227708258_0018_r_000000_0' done.
2015-02-10 19:08:25,623 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary
2015-02-10 19:08:25,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:25,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:25,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:25,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:25,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:25,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:25,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:25,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:25,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:25,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:25,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:25,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:25,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:25,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:25,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:25,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:25,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:25,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:25,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:25,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:25,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:25,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:25,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:25,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:25,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:25,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:25,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:25,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:25,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:25,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:25,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:25,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:25,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:25,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:25,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:25,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:25,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:25,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:25,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:25,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:25,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:25,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:25,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:25,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:25,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:25,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:25,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:25,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:25,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:25,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:25,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:25,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:25,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:25,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:25,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:25,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:25,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:25,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:25,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:25,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:25,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:25,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:25,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:25,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:25,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:25,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:25,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:25,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:25,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:25,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:25,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:25,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:25,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:25,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:25,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:25,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:25,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:25,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:25,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:25,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:25,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:25,655 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:25,655 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:25,655 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:25,655 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:25,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:25,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:25,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:25,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:25,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:25,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:25,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:25,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:25,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:25,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:25,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:25,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:25,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:25,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:25,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:25,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:25,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:25,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:25,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:25,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:25,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:25,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:25,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:25,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:25,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:25,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:25,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:25,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:25,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:25,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:25,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:25,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:25,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:25,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:25,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:25,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:25,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:25,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:25,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:25,681 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:25,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:25,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:25,714 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:25,716 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE
2015-02-10 19:08:25,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:25,731 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:25,732 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:25,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:25,744 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:25,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:25,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-10 19:08:25,746 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:25,746 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:25,747 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:25,748 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_ARGS_SWAP
2015-02-10 19:08:25,749 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:25,751 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:25,775 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:25,776 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:25,795 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:25,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:25,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:25,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:25,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:25,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:25,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:25,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:25,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:25,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:25,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:25,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:25,813 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local234081247_0019
2015-02-10 19:08:25,831 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity234081247/.staging/job_local234081247_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:25,832 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity234081247/.staging/job_local234081247_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:25,883 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local234081247_0019/job_local234081247_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:25,883 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local234081247_0019/job_local234081247_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:25,884 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:25,885 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local234081247_0019
2015-02-10 19:08:25,885 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:25,885 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:25,886 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:25,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:25,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local234081247_0019_m_000000_0
2015-02-10 19:08:25,891 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:25,892 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:25,893 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@a604dd8
2015-02-10 19:08:25,894 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:25,894 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:25,919 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:25,919 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:25,919 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:25,920 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:25,920 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:25,922 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:25,923 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:25,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:25,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:25,934 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,934 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:25,934 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:25,934 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:25,934 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:25,938 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:25,940 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local234081247_0019_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:25,942 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:25,942 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local234081247_0019_m_000000_0' done.
2015-02-10 19:08:25,942 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local234081247_0019_m_000000_0
2015-02-10 19:08:25,943 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:25,948 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:25,949 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:25,949 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:25,950 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:25,951 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:25,958 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:25,958 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-10 19:08:25,972 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local234081247_0019_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:25,973 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:25,974 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local234081247_0019_r_000000_0 is allowed to commit now
2015-02-10 19:08:25,974 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local234081247_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary/0/task_local234081247_0019_r_000000
2015-02-10 19:08:25,975 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:25,976 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local234081247_0019_r_000000_0' done.
2015-02-10 19:08:25,996 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary
2015-02-10 19:08:26,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:26,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:26,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:26,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:26,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:26,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:26,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:26,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:26,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:26,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:26,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:26,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:26,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:26,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:26,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:26,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:26,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:26,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:26,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:26,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:26,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:26,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:26,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:26,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:26,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:26,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:26,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:26,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:26,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:26,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:26,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:26,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:26,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:26,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:26,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:26,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:26,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:26,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:26,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:26,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:26,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:26,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:26,027 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:26,028 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:26,028 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:26,029 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:26,030 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:26,031 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:26,031 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:26,031 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:26,032 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:26,032 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:26,032 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:26,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:26,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:26,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:26,034 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,034 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:26,034 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:26,035 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:26,035 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:26,035 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:26,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:26,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:26,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:26,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:26,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:26,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:26,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:26,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:26,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:26,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:26,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:26,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:26,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:26,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:26,041 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:26,041 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:26,042 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:26,042 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:26,042 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:26,043 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:26,043 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:26,043 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:26,044 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:26,044 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:26,044 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:26,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:26,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:26,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:26,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:26,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:26,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:26,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:26,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:26,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:26,048 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:26,048 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:26,049 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:26,049 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:26,049 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:26,050 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:26,050 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:26,050 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:26,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:26,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:26,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:26,052 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:26,052 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:26,052 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:26,052 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:26,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:26,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:26,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:26,053 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:26,054 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:26,054 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:26,054 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:26,054 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:26,055 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:26,055 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:26,055 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:26,055 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:26,056 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,071 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,105 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,107 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP
2015-02-10 19:08:26,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,126 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:26,127 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:26,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:26,141 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:26,141 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:26,142 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-10 19:08:26,142 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:26,142 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:26,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:26,144 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_'field'_-1
2015-02-10 19:08:26,145 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:26,146 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:26,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:26,171 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,191 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:26,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:26,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:26,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:26,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:26,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:26,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:26,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:26,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:26,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:26,216 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1741887878_0020
2015-02-10 19:08:26,239 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1741887878/.staging/job_local1741887878_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:26,241 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1741887878/.staging/job_local1741887878_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:26,297 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1741887878_0020/job_local1741887878_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:26,298 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1741887878_0020/job_local1741887878_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:26,299 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:26,300 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:26,300 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:26,300 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1741887878_0020
2015-02-10 19:08:26,301 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:26,302 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:26,303 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1741887878_0020_m_000000_0
2015-02-10 19:08:26,304 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:26,305 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:26,306 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2bb5f635
2015-02-10 19:08:26,307 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:26,307 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:26,330 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:26,330 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:26,330 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:26,330 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:26,330 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:26,332 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:26,332 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:26,338 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:26,338 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:26,342 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:26,342 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:26,342 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:26,342 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:26,343 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:26,346 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:26,348 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1741887878_0020_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:26,350 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:26,350 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1741887878_0020_m_000000_0' done.
2015-02-10 19:08:26,350 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1741887878_0020_m_000000_0
2015-02-10 19:08:26,350 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:26,355 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:26,355 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:26,356 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:26,356 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:26,357 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:26,357 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:26,363 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:26,364 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-10 19:08:26,377 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1741887878_0020_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:26,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:26,379 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1741887878_0020_r_000000_0 is allowed to commit now
2015-02-10 19:08:26,380 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1741887878_0020_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary/0/task_local1741887878_0020_r_000000
2015-02-10 19:08:26,381 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:26,381 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1741887878_0020_r_000000_0' done.
2015-02-10 19:08:26,398 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary
2015-02-10 19:08:26,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:26,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:26,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:26,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:26,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:26,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:26,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:26,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:26,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:26,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:26,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:26,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:26,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:26,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:26,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:26,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:26,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:26,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:26,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:26,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:26,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:26,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:26,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:26,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:26,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:26,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:26,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:26,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:26,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:26,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:26,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:26,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:26,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:26,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:26,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:26,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:26,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:26,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:26,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:26,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:26,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:26,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:26,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:26,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:26,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:26,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:26,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:26,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:26,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:26,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:26,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:26,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:26,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:26,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:26,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:26,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:26,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:26,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:26,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:26,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:26,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:26,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:26,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:26,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:26,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:26,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:26,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:26,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:26,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:26,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:26,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:26,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:26,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:26,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:26,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:26,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:26,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:26,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:26,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:26,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:26,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:26,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:26,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:26,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:26,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:26,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:26,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:26,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:26,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:26,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:26,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:26,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:26,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:26,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:26,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:26,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:26,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:26,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:26,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:26,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:26,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:26,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:26,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:26,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:26,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:26,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:26,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:26,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:26,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:26,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:26,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:26,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:26,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:26,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:26,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:26,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:26,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:26,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:26,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:26,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:26,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:26,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:26,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,456 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,477 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,492 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,494 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1
2015-02-10 19:08:26,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,513 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:26,513 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:26,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:26,529 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:26,529 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:26,529 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-10 19:08:26,530 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:26,530 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:26,530 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:26,532 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_'field'
2015-02-10 19:08:26,532 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:26,533 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:26,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:26,556 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,575 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:26,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:26,585 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:26,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:26,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:26,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:26,586 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:26,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:26,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:26,587 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:26,598 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local452521912_0021
2015-02-10 19:08:26,620 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity452521912/.staging/job_local452521912_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:26,622 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity452521912/.staging/job_local452521912_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:26,681 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local452521912_0021/job_local452521912_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:26,681 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local452521912_0021/job_local452521912_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:26,683 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:26,684 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local452521912_0021
2015-02-10 19:08:26,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:26,684 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:26,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:26,688 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:26,688 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local452521912_0021_m_000000_0
2015-02-10 19:08:26,690 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:26,692 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:26,692 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@361b90be
2015-02-10 19:08:26,693 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:26,693 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:26,719 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:26,719 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:26,719 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:26,719 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:26,720 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:26,721 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:26,721 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:26,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:26,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:26,731 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:26,732 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:26,732 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:26,732 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:26,732 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:26,735 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:26,737 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local452521912_0021_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:26,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:26,739 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local452521912_0021_m_000000_0' done.
2015-02-10 19:08:26,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local452521912_0021_m_000000_0
2015-02-10 19:08:26,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:26,744 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:26,744 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:26,745 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:26,745 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:26,745 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:26,746 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:26,751 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:26,751 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-10 19:08:26,763 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local452521912_0021_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:26,766 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:26,766 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local452521912_0021_r_000000_0 is allowed to commit now
2015-02-10 19:08:26,767 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local452521912_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary/0/task_local452521912_0021_r_000000
2015-02-10 19:08:26,768 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:26,768 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local452521912_0021_r_000000_0' done.
2015-02-10 19:08:26,786 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary
2015-02-10 19:08:26,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:26,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:26,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:26,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:26,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:26,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:26,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:26,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:26,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:26,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:26,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:26,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:26,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:26,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:26,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:26,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:26,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:26,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:26,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:26,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:26,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:26,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:26,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:26,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:26,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:26,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:26,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:26,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:26,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:26,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:26,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:26,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:26,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:26,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:26,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:26,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:26,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:26,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:26,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:26,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:26,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:26,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:26,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:26,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:26,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:26,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:26,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:26,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:26,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:26,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:26,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:26,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:26,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:26,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:26,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:26,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:26,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:26,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:26,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:26,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:26,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:26,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:26,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:26,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:26,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:26,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:26,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:26,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:26,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:26,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:26,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:26,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:26,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:26,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:26,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:26,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:26,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:26,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:26,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:26,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:26,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:26,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:26,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:26,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:26,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:26,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:26,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:26,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:26,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:26,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:26,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:26,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:26,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:26,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:26,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:26,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:26,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:26,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:26,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:26,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:26,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:26,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:26,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:26,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:26,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:26,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:26,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:26,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:26,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:26,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:26,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:26,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:26,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:26,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:26,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:26,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:26,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:26,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:26,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:26,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:26,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:26,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:26,826 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,841 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,858 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,872 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,873 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'
2015-02-10 19:08:26,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:26,889 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:26,889 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:26,895 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:26,901 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:26,901 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:26,901 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-10 19:08:26,901 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:26,901 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:26,901 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:26,902 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_RESULTS
2015-02-10 19:08:26,903 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:26,904 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:26,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:26,927 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:26,946 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:26,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:26,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:26,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:26,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:26,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:26,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:26,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:26,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:26,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:26,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:26,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:26,964 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local238341451_0022
2015-02-10 19:08:26,981 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity238341451/.staging/job_local238341451_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:26,983 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity238341451/.staging/job_local238341451_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:27,036 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local238341451_0022/job_local238341451_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:27,037 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local238341451_0022/job_local238341451_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:27,038 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:27,039 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local238341451_0022
2015-02-10 19:08:27,039 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:27,039 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:27,039 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:27,042 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:27,042 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local238341451_0022_m_000000_0
2015-02-10 19:08:27,043 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:27,045 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:27,045 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@f32b815
2015-02-10 19:08:27,046 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:27,046 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:27,071 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:27,071 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:27,072 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:27,072 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:27,072 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:27,073 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:27,073 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:27,079 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:27,079 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:27,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,083 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:27,083 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:27,083 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:27,083 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:27,087 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:27,088 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local238341451_0022_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:27,090 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:27,090 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local238341451_0022_m_000000_0' done.
2015-02-10 19:08:27,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local238341451_0022_m_000000_0
2015-02-10 19:08:27,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:27,095 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:27,096 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:27,096 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:27,097 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,097 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:27,097 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:27,101 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:27,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:27,103 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-10 19:08:27,115 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local238341451_0022_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:27,116 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,116 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local238341451_0022_r_000000_0 is allowed to commit now
2015-02-10 19:08:27,117 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local238341451_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary/0/task_local238341451_0022_r_000000
2015-02-10 19:08:27,118 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:27,118 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local238341451_0022_r_000000_0' done.
2015-02-10 19:08:27,138 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary
2015-02-10 19:08:27,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:27,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:27,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:27,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:27,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:27,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:27,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:27,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:27,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:27,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:27,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:27,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:27,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:27,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:27,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:27,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:27,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:27,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:27,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:27,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:27,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:27,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:27,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:27,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:27,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:27,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:27,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:27,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:27,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:27,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:27,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:27,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:27,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:27,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:27,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:27,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:27,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:27,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:27,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:27,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:27,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:27,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:27,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:27,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:27,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:27,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:27,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:27,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:27,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:27,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:27,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:27,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:27,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:27,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:27,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:27,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:27,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:27,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:27,165 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:27,165 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:27,165 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:27,165 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:27,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:27,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:27,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:27,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:27,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:27,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:27,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:27,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:27,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:27,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:27,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:27,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:27,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:27,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:27,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:27,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:27,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:27,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:27,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:27,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:27,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:27,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:27,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:27,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:27,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:27,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:27,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:27,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:27,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:27,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:27,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:27,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:27,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:27,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:27,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:27,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:27,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:27,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:27,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:27,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:27,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:27,176 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:27,176 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:27,176 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:27,176 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:27,177 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:27,177 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:27,177 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:27,177 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:27,178 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:27,178 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:27,178 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:27,178 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:27,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:27,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:27,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:27,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:27,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:27,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:27,182 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:27,182 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,197 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,228 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,229 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS
2015-02-10 19:08:27,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,245 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:27,246 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:27,252 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:27,257 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:27,257 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:27,257 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-10 19:08:27,257 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:27,258 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:27,258 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:27,259 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_'field'_ALL
2015-02-10 19:08:27,259 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:27,260 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:27,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:27,284 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,302 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:27,311 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:27,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:27,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:27,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:27,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:27,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:27,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:27,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:27,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:27,321 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local689354271_0023
2015-02-10 19:08:27,337 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity689354271/.staging/job_local689354271_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:27,341 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity689354271/.staging/job_local689354271_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:27,388 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local689354271_0023/job_local689354271_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:27,389 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local689354271_0023/job_local689354271_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:27,391 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:27,391 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local689354271_0023
2015-02-10 19:08:27,391 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:27,391 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:27,392 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:27,394 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:27,394 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local689354271_0023_m_000000_0
2015-02-10 19:08:27,396 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:27,398 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:27,398 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3f75c03e
2015-02-10 19:08:27,399 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:27,400 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:27,426 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:27,427 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:27,427 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:27,427 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:27,427 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:27,429 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:27,429 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:27,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:27,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:27,440 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,440 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:27,441 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:27,441 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:27,441 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:27,444 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:27,446 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local689354271_0023_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:27,448 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:27,448 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local689354271_0023_m_000000_0' done.
2015-02-10 19:08:27,449 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local689354271_0023_m_000000_0
2015-02-10 19:08:27,449 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:27,453 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:27,454 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:27,454 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:27,455 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,455 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:27,455 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:27,461 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:27,461 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-10 19:08:27,473 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local689354271_0023_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:27,474 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,474 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local689354271_0023_r_000000_0 is allowed to commit now
2015-02-10 19:08:27,475 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local689354271_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary/0/task_local689354271_0023_r_000000
2015-02-10 19:08:27,476 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:27,476 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local689354271_0023_r_000000_0' done.
2015-02-10 19:08:27,492 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary
2015-02-10 19:08:27,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:27,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:27,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:27,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:27,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:27,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:27,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:27,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:27,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:27,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:27,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:27,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:27,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:27,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:27,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:27,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:27,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:27,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:27,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:27,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:27,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:27,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:27,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:27,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:27,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:27,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:27,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:27,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:27,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:27,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:27,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:27,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:27,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:27,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:27,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:27,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:27,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:27,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:27,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:27,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:27,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:27,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:27,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:27,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:27,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:27,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:27,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:27,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:27,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:27,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:27,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:27,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:27,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:27,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:27,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:27,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:27,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:27,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:27,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:27,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:27,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:27,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:27,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:27,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:27,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:27,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:27,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:27,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:27,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:27,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:27,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:27,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:27,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:27,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:27,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:27,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:27,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:27,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:27,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:27,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:27,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:27,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:27,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:27,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:27,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:27,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:27,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:27,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:27,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:27,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:27,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:27,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:27,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:27,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:27,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:27,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:27,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:27,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:27,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:27,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:27,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:27,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:27,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:27,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:27,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:27,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:27,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:27,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:27,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:27,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:27,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:27,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:27,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:27,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:27,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:27,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:27,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:27,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:27,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:27,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:27,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:27,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:27,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,558 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,573 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,590 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,591 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL
2015-02-10 19:08:27,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,607 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:27,607 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:27,612 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_REPLACE
2015-02-10 19:08:27,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,627 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:27,627 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:27,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:27,639 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:27,640 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:27,640 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-10 19:08:27,640 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:27,640 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:27,640 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:27,641 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_'field'_SWAP
2015-02-10 19:08:27,642 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:27,643 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:27,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:27,689 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,707 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:27,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:27,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:27,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:27,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:27,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:27,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:27,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:27,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:27,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:27,724 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local433884844_0024
2015-02-10 19:08:27,742 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity433884844/.staging/job_local433884844_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:27,745 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity433884844/.staging/job_local433884844_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:27,792 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local433884844_0024/job_local433884844_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:27,792 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local433884844_0024/job_local433884844_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:27,794 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:27,794 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local433884844_0024
2015-02-10 19:08:27,794 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:27,795 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:27,795 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:27,798 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:27,798 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local433884844_0024_m_000000_0
2015-02-10 19:08:27,799 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:27,801 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:27,801 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@375062c7
2015-02-10 19:08:27,802 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:27,802 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:27,827 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:27,828 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:27,828 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:27,828 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:27,828 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:27,829 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:27,829 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:27,835 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:27,835 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:27,839 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,839 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:27,839 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:27,839 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:27,839 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:27,843 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:27,844 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local433884844_0024_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:27,846 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:27,846 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local433884844_0024_m_000000_0' done.
2015-02-10 19:08:27,846 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local433884844_0024_m_000000_0
2015-02-10 19:08:27,846 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:27,851 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:27,851 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:27,852 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:27,852 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:27,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:27,858 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:27,858 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-10 19:08:27,870 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local433884844_0024_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:27,871 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:27,871 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local433884844_0024_r_000000_0 is allowed to commit now
2015-02-10 19:08:27,872 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local433884844_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary/0/task_local433884844_0024_r_000000
2015-02-10 19:08:27,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:27,873 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local433884844_0024_r_000000_0' done.
2015-02-10 19:08:27,893 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary
2015-02-10 19:08:27,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:27,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:27,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:27,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:27,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:27,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:27,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:27,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:27,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:27,910 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:27,910 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:27,910 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:27,911 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:27,911 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:27,911 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:27,912 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:27,912 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:27,912 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:27,913 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:27,913 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:27,913 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:27,914 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:27,914 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:27,914 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:27,915 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:27,915 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:27,915 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:27,916 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:27,916 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:27,916 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:27,917 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,917 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:27,917 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:27,918 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:27,918 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:27,919 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:27,919 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:27,919 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:27,920 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:27,920 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:27,920 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:27,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:27,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:27,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:27,922 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:27,922 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:27,922 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:27,923 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:27,923 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:27,924 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:27,924 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:27,924 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:27,925 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:27,925 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:27,925 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:27,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:27,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:27,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,927 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:27,927 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:27,928 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:27,928 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:27,928 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:27,929 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:27,929 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:27,929 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:27,930 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:27,930 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:27,930 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:27,931 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:27,931 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:27,932 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:27,932 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:27,932 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:27,933 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:27,933 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:27,933 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:27,934 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:27,934 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:27,934 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:27,935 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:27,935 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:27,935 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:27,936 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:27,936 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:27,937 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:27,937 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:27,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:27,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:27,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:27,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:27,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:27,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:27,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:27,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:27,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:27,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:27,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:27,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:27,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:27,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:27,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:27,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:27,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:27,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:27,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:27,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:27,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:27,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:27,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:27,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:27,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:27,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:27,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:27,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:27,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:27,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:27,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:27,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:27,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:27,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:27,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:27,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:27,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:27,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,962 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:27,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:27,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:27,993 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:27,995 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP
2015-02-10 19:08:28,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,011 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:28,012 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:28,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:28,023 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:28,024 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:28,024 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-10 19:08:28,024 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:28,024 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:28,024 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:28,025 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_UNKNOWN_-1
2015-02-10 19:08:28,027 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:28,028 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:28,051 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:28,055 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,073 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:28,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:28,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:28,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:28,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:28,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:28,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:28,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:28,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:28,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:28,090 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local986310208_0025
2015-02-10 19:08:28,107 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity986310208/.staging/job_local986310208_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:28,108 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity986310208/.staging/job_local986310208_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:28,151 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local986310208_0025/job_local986310208_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:28,151 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local986310208_0025/job_local986310208_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:28,152 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:28,153 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local986310208_0025
2015-02-10 19:08:28,153 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:28,153 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:28,153 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:28,156 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:28,156 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local986310208_0025_m_000000_0
2015-02-10 19:08:28,158 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:28,159 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:28,160 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@63e06937
2015-02-10 19:08:28,161 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:28,161 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:28,187 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:28,188 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:28,188 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:28,188 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:28,189 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:28,190 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:28,190 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:28,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:28,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:28,201 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,201 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:28,201 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:28,201 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:28,201 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:28,204 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:28,206 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local986310208_0025_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:28,208 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:28,208 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local986310208_0025_m_000000_0' done.
2015-02-10 19:08:28,208 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local986310208_0025_m_000000_0
2015-02-10 19:08:28,208 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:28,211 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:28,213 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:28,214 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:28,214 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:28,215 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,215 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:28,215 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:28,221 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:28,221 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-10 19:08:28,233 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local986310208_0025_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:28,234 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,235 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local986310208_0025_r_000000_0 is allowed to commit now
2015-02-10 19:08:28,235 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local986310208_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary/0/task_local986310208_0025_r_000000
2015-02-10 19:08:28,236 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:28,237 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local986310208_0025_r_000000_0' done.
2015-02-10 19:08:28,253 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary
2015-02-10 19:08:28,267 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:28,267 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:28,267 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:28,267 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:28,268 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:28,268 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:28,268 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:28,268 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:28,268 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:28,269 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:28,269 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:28,269 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:28,269 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:28,270 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:28,270 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:28,270 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:28,270 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:28,272 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:28,272 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:28,272 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:28,273 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:28,273 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:28,273 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:28,273 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:28,274 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:28,274 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:28,274 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:28,274 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:28,274 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:28,275 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:28,275 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,275 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:28,275 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:28,276 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:28,276 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:28,276 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:28,276 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:28,276 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:28,277 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:28,277 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:28,277 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:28,277 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:28,278 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:28,278 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:28,278 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:28,278 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:28,279 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:28,279 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:28,279 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:28,279 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:28,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:28,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:28,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:28,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:28,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:28,284 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:28,284 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:28,284 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:28,284 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:28,286 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:28,286 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:28,286 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:28,286 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:28,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:28,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:28,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:28,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:28,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:28,288 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:28,288 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:28,288 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:28,288 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:28,289 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:28,289 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:28,289 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:28,289 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:28,289 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:28,290 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:28,290 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:28,290 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:28,290 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:28,291 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:28,291 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:28,291 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:28,291 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:28,292 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:28,292 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:28,292 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:28,292 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:28,292 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:28,293 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:28,293 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:28,293 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:28,293 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:28,294 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:28,294 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:28,294 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:28,294 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:28,295 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:28,295 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:28,295 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:28,295 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:28,296 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:28,296 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:28,296 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:28,296 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:28,296 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:28,297 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,312 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,329 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,329 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,330 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,345 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,346 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1
2015-02-10 19:08:28,360 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,361 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:28,362 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:28,366 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_'field'
2015-02-10 19:08:28,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,381 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:28,382 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:28,387 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:28,392 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:28,392 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:28,393 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-10 19:08:28,393 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:28,393 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:28,395 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:28,395 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_RESULTS
2015-02-10 19:08:28,396 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:28,397 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:28,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:28,421 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,439 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:28,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:28,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:28,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:28,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:28,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:28,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:28,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:28,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:28,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:28,458 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1227654130_0026
2015-02-10 19:08:28,475 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1227654130/.staging/job_local1227654130_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:28,477 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1227654130/.staging/job_local1227654130_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:28,520 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1227654130_0026/job_local1227654130_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:28,520 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1227654130_0026/job_local1227654130_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:28,522 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:28,523 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:28,523 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1227654130_0026
2015-02-10 19:08:28,523 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:28,523 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:28,527 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:28,527 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1227654130_0026_m_000000_0
2015-02-10 19:08:28,529 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:28,531 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:28,531 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6c15f918
2015-02-10 19:08:28,532 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:28,533 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:28,559 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:28,560 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:28,560 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:28,560 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:28,560 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:28,562 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:28,562 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:28,569 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:28,569 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:28,573 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,573 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:28,574 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:28,574 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:28,574 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:28,577 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:28,579 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1227654130_0026_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:28,581 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:28,581 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1227654130_0026_m_000000_0' done.
2015-02-10 19:08:28,581 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1227654130_0026_m_000000_0
2015-02-10 19:08:28,582 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:28,586 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:28,587 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:28,587 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:28,587 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,588 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:28,588 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:28,595 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:28,595 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-10 19:08:28,608 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1227654130_0026_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:28,609 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,609 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1227654130_0026_r_000000_0 is allowed to commit now
2015-02-10 19:08:28,610 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1227654130_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary/0/task_local1227654130_0026_r_000000
2015-02-10 19:08:28,611 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:28,612 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1227654130_0026_r_000000_0' done.
2015-02-10 19:08:28,626 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary
2015-02-10 19:08:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:28,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:28,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:28,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:28,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:28,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:28,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:28,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:28,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:28,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:28,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:28,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:28,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:28,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:28,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:28,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:28,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:28,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:28,649 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:28,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:28,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:28,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:28,651 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:28,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:28,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:28,652 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:28,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:28,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:28,653 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:28,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:28,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:28,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:28,655 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:28,655 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:28,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:28,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:28,656 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:28,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:28,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:28,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:28,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:28,658 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:28,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:28,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:28,659 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:28,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:28,660 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:28,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:28,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:28,661 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:28,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:28,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:28,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:28,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:28,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:28,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:28,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:28,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:28,665 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:28,665 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:28,665 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:28,666 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:28,666 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:28,666 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:28,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:28,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:28,667 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:28,668 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:28,668 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:28,669 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:28,669 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:28,669 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:28,670 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:28,670 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:28,670 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:28,671 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:28,671 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:28,671 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:28,672 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:28,672 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:28,672 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:28,673 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:28,673 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:28,674 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:28,674 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:28,674 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:28,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:28,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:28,675 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:28,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:28,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:28,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:28,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:28,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:28,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:28,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:28,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:28,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:28,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:28,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:28,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:28,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:28,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:28,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:28,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:28,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:28,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:28,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:28,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:28,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:28,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,691 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:28,698 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,728 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,729 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS
2015-02-10 19:08:28,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:28,745 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:28,746 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:28,751 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:28,757 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:28,757 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:28,757 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-10 19:08:28,757 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:28,757 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:28,758 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:28,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_UNKNOWN_ALL
2015-02-10 19:08:28,760 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:28,761 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:28,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:28,784 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:28,802 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:28,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:28,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:28,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:28,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:28,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:28,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:28,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:28,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:28,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:28,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:28,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:28,820 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1610968940_0027
2015-02-10 19:08:28,836 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1610968940/.staging/job_local1610968940_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:28,838 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1610968940/.staging/job_local1610968940_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:28,885 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1610968940_0027/job_local1610968940_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:28,886 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1610968940_0027/job_local1610968940_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:28,888 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:28,888 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:28,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:28,889 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1610968940_0027
2015-02-10 19:08:28,889 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:28,892 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:28,892 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1610968940_0027_m_000000_0
2015-02-10 19:08:28,894 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:28,895 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:28,895 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@62543f11
2015-02-10 19:08:28,896 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:28,896 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:28,922 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:28,922 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:28,922 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:28,922 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:28,922 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:28,924 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:28,924 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:28,929 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:28,930 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:28,933 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,933 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:28,934 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:28,934 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:28,934 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:28,936 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:28,938 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1610968940_0027_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:28,940 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:28,940 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1610968940_0027_m_000000_0' done.
2015-02-10 19:08:28,940 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1610968940_0027_m_000000_0
2015-02-10 19:08:28,940 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:28,945 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:28,945 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:28,946 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:28,947 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,947 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:28,947 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:28,953 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:28,953 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-10 19:08:28,965 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1610968940_0027_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:28,966 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:28,966 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1610968940_0027_r_000000_0 is allowed to commit now
2015-02-10 19:08:28,967 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1610968940_0027_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary/0/task_local1610968940_0027_r_000000
2015-02-10 19:08:28,968 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:28,968 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1610968940_0027_r_000000_0' done.
2015-02-10 19:08:28,990 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary
2015-02-10 19:08:29,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:29,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:29,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:29,004 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:29,004 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:29,005 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:29,005 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:29,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:29,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:29,006 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:29,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:29,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:29,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:29,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:29,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:29,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:29,008 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:29,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:29,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:29,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:29,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:29,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:29,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:29,010 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:29,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:29,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:29,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:29,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:29,011 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:29,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:29,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:29,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:29,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:29,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:29,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:29,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:29,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:29,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:29,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:29,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:29,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:29,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:29,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:29,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:29,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:29,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:29,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:29,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:29,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:29,018 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:29,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:29,019 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:29,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:29,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:29,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:29,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:29,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:29,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:29,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:29,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:29,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:29,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:29,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:29,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:29,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:29,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:29,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:29,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:29,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:29,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:29,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:29,027 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:29,027 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:29,027 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:29,028 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:29,028 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:29,028 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:29,029 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:29,029 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:29,029 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:29,030 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:29,030 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:29,030 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:29,030 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:29,031 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:29,031 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:29,031 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:29,032 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:29,032 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:29,032 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:29,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:29,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:29,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:29,034 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:29,034 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:29,034 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:29,035 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:29,035 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:29,035 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:29,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:29,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:29,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:29,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:29,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:29,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:29,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:29,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:29,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:29,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:29,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:29,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:29,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:29,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:29,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:29,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:29,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:29,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:29,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:29,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:29,041 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:29,041 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:29,041 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:29,041 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,056 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,072 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,072 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,088 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,089 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL
2015-02-10 19:08:29,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,105 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:29,106 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:29,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:29,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:29,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:29,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-10 19:08:29,118 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:29,119 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:29,119 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:29,119 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-10 19:08:29,120 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:29,121 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:29,121 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:29,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:29,143 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,161 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:29,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:29,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:29,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:29,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:29,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:29,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:29,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:29,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:29,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:29,178 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local372555881_0028
2015-02-10 19:08:29,194 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity372555881/.staging/job_local372555881_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:29,195 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity372555881/.staging/job_local372555881_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:29,237 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local372555881_0028/job_local372555881_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:29,237 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local372555881_0028/job_local372555881_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:29,238 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:29,238 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local372555881_0028
2015-02-10 19:08:29,238 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:29,238 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:29,239 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:29,241 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:29,241 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local372555881_0028_m_000000_0
2015-02-10 19:08:29,243 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:29,244 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:29,244 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@628e5ef0
2015-02-10 19:08:29,245 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:29,245 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:29,271 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:29,271 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:29,271 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:29,271 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:29,271 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:29,272 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:29,272 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:29,278 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:29,278 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:29,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:29,282 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:29,282 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:29,282 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:29,282 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:29,285 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:29,287 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local372555881_0028_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:29,288 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:29,289 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local372555881_0028_m_000000_0' done.
2015-02-10 19:08:29,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local372555881_0028_m_000000_0
2015-02-10 19:08:29,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:29,293 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:29,294 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:29,294 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:29,295 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:29,295 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:29,295 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:29,301 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:29,301 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-10 19:08:29,309 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:29,311 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local372555881_0028
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:29,311 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local372555881_0028 state at FAILED
2015-02-10 19:08:29,311 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:29,312 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:29,312 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:29,316 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:29,316 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-10 19:08:29,317 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:29,317 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 19:08:29,317 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 19:08:29,318 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE/_temporary
2015-02-10 19:08:29,318 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE
2015-02-10 19:08:29,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:29,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:29,334 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:29,334 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:29,340 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:29,342 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:29,342 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:29,345 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:29,346 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:29,346 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-10 19:08:29,347 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:29,347 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:29,348 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:29,349 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_UNKNOWN_SWAP
2015-02-10 19:08:29,349 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:29,350 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:29,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:29,374 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,393 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:29,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:29,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:29,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:29,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:29,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:29,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:29,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:29,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:29,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:29,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:29,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:29,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:29,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:29,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:29,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:29,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:29,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:29,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:29,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:29,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:29,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:29,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:29,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:29,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:29,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:29,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:29,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:29,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:29,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:29,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:29,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:29,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:29,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:29,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:29,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:29,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:29,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:29,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:29,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:29,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:29,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:29,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:29,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:29,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:29,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:29,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:29,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:29,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:29,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:29,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:29,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:29,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:29,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:29,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:29,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:29,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:29,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:29,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:29,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:29,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:29,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:29,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:29,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:29,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:29,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:29,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:29,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:29,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:29,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:29,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:29,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:29,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:29,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:29,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:29,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:29,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:29,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:29,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:29,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:29,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:29,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:29,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:29,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:29,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:29,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:29,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:29,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:29,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:29,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:29,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:29,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:29,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:29,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:29,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:29,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:29,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:29,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:29,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:29,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:29,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:29,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:29,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:29,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:29,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:29,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:29,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:29,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:29,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:29,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:29,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:29,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:29,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:29,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:29,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:29,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:29,438 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local636698167_0029
2015-02-10 19:08:29,454 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity636698167/.staging/job_local636698167_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:29,455 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity636698167/.staging/job_local636698167_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:29,497 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local636698167_0029/job_local636698167_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:29,497 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local636698167_0029/job_local636698167_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:29,498 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:29,499 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local636698167_0029
2015-02-10 19:08:29,499 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:29,499 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:29,499 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:29,502 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:29,502 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local636698167_0029_m_000000_0
2015-02-10 19:08:29,504 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:29,505 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:29,506 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@20ca0c9
2015-02-10 19:08:29,507 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:29,507 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:29,536 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:29,625 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:29,625 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:29,625 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:29,626 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:29,626 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:29,628 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:29,628 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:29,634 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:29,634 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:29,637 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:29,638 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:29,638 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:29,638 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:29,638 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:29,641 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:29,642 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local636698167_0029_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:29,644 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:29,644 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local636698167_0029_m_000000_0' done.
2015-02-10 19:08:29,644 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local636698167_0029_m_000000_0
2015-02-10 19:08:29,644 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:29,649 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:29,649 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:29,650 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:29,650 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:29,651 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:29,651 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:29,656 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:29,656 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-10 19:08:29,678 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local636698167_0029_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:29,679 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:29,680 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local636698167_0029_r_000000_0 is allowed to commit now
2015-02-10 19:08:29,680 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local636698167_0029_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary/0/task_local636698167_0029_r_000000
2015-02-10 19:08:29,681 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:29,681 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local636698167_0029_r_000000_0' done.
2015-02-10 19:08:29,697 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary
2015-02-10 19:08:29,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:29,712 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:29,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:29,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:29,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:29,713 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:29,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:29,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:29,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:29,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:29,714 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:29,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:29,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:29,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:29,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:29,715 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:29,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:29,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:29,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:29,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:29,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:29,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:29,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:29,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:29,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:29,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:29,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:29,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:29,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:29,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:29,718 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:29,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:29,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:29,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:29,719 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:29,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:29,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:29,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:29,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:29,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:29,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:29,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:29,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:29,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:29,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:29,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:29,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:29,723 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:29,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:29,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:29,724 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:29,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:29,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:29,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:29,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:29,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:29,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:29,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:29,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:29,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:29,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:29,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:29,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:29,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:29,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:29,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:29,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:29,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:29,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:29,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:29,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:29,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:29,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:29,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:29,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:29,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:29,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:29,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:29,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:29,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:29,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:29,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:29,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:29,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:29,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:29,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:29,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:29,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:29,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:29,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:29,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:29,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:29,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:29,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:29,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:29,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:29,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:29,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:29,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:29,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:29,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:29,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:29,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:29,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:29,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:29,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:29,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:29,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:29,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:29,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:29,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:29,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:29,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:29,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:29,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:29,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:29,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:29,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:29,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:29,748 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:29,748 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:29,748 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:29,749 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,764 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,780 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,795 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,797 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP
2015-02-10 19:08:29,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:29,813 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:29,813 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:29,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:29,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:29,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:29,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-10 19:08:29,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:29,824 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:29,825 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:29,825 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-10 19:08:29,826 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:29,828 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:29,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:29,851 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:29,869 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:29,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:29,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:29,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:29,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:29,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:29,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:29,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:29,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:29,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:29,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:29,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:29,888 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1266444281_0030
2015-02-10 19:08:29,904 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1266444281/.staging/job_local1266444281_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:29,905 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1266444281/.staging/job_local1266444281_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:29,949 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1266444281_0030/job_local1266444281_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:29,949 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1266444281_0030/job_local1266444281_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:29,950 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:29,950 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1266444281_0030
2015-02-10 19:08:29,950 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:29,951 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:29,951 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:29,954 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:29,954 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1266444281_0030_m_000000_0
2015-02-10 19:08:29,956 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:29,957 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:29,957 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@19afdb9
2015-02-10 19:08:29,958 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:29,958 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:29,976 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:29,976 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:29,976 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:29,977 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:29,977 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:29,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:29,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:29,984 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:29,984 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:29,987 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:29,987 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:29,988 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:29,988 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:29,988 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:29,990 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:29,992 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1266444281_0030_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:29,994 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:29,994 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1266444281_0030_m_000000_0' done.
2015-02-10 19:08:29,994 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1266444281_0030_m_000000_0
2015-02-10 19:08:29,994 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:29,998 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:29,999 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:30,000 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:30,000 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,000 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:30,000 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,006 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,006 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-10 19:08:30,014 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,016 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1266444281_0030
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,023 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1266444281_0030 state at FAILED
2015-02-10 19:08:30,023 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:30,024 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:30,024 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:30,028 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:30,029 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-10 19:08:30,030 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:30,030 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1/_temporary
2015-02-10 19:08:30,030 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1
2015-02-10 19:08:30,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:30,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:30,045 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:30,046 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:30,047 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:30,052 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_'field'
2015-02-10 19:08:30,065 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:30,066 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:30,067 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:30,073 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:30,075 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:30,076 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:30,079 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:30,080 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,080 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-10 19:08:30,080 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:30,080 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:30,080 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:30,080 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:30,081 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_RESULTS
2015-02-10 19:08:30,083 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,084 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,107 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:30,108 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:30,125 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:30,134 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:30,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:30,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:30,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:30,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:30,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:30,135 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:30,136 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:30,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:30,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:30,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:30,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:30,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:30,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:30,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:30,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:30,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:30,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:30,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:30,138 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:30,139 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:30,140 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:30,141 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:30,141 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:30,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:30,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:30,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:30,142 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:30,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:30,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:30,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:30,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:30,145 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:30,146 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:30,147 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:30,148 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:30,149 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:30,149 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:30,149 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:30,149 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:30,150 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:30,150 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:30,150 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:30,150 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:30,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:30,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:30,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:30,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:30,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:30,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:30,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:30,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:30,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:30,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:30,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:30,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:30,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:30,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:30,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:30,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:30,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:30,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:30,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:30,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:30,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:30,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:30,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:30,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:30,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:30,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:30,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:30,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:30,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:30,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:30,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:30,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:30,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:30,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:30,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:30,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:30,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:30,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:30,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:30,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:30,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:30,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:30,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:30,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:30,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:30,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:30,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:30,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:30,168 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1164849512_0031
2015-02-10 19:08:30,184 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1164849512/.staging/job_local1164849512_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,185 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1164849512/.staging/job_local1164849512_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:30,228 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1164849512_0031/job_local1164849512_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,229 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1164849512_0031/job_local1164849512_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:30,230 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:30,230 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1164849512_0031
2015-02-10 19:08:30,231 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:30,231 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:30,231 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:30,234 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:30,234 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1164849512_0031_m_000000_0
2015-02-10 19:08:30,235 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:30,237 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:30,237 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@e40e825
2015-02-10 19:08:30,238 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:30,238 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:30,264 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:30,264 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:30,264 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:30,264 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:30,264 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:30,266 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:30,266 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,272 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,272 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,275 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,275 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:30,275 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:30,275 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:30,276 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:30,278 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:30,280 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1164849512_0031_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:30,281 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:30,282 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1164849512_0031_m_000000_0' done.
2015-02-10 19:08:30,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1164849512_0031_m_000000_0
2015-02-10 19:08:30,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:30,286 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:30,287 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:30,287 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:30,288 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,288 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:30,288 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,293 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,293 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-10 19:08:30,301 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,304 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1164849512_0031
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,305 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1164849512_0031 state at FAILED
2015-02-10 19:08:30,306 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:30,306 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:30,306 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:30,310 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:30,311 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_RESULTS
2015-02-10 19:08:30,311 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:30,312 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS/_temporary
2015-02-10 19:08:30,312 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS
2015-02-10 19:08:30,326 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:30,326 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:30,326 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:30,328 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:30,328 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:30,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:30,335 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:30,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:30,339 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:30,339 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,340 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-10 19:08:30,340 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:30,340 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:30,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:30,342 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-10 19:08:30,343 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,344 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:30,368 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:30,385 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:30,395 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:30,395 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:30,395 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:30,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:30,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:30,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:30,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:30,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:30,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:30,397 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:30,397 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:30,397 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:30,397 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:30,397 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:30,397 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:30,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:30,399 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:30,400 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:30,400 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:30,401 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:30,401 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:30,402 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:30,402 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:30,402 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:30,402 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:30,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:30,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:30,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:30,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:30,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:30,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:30,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:30,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:30,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:30,405 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:30,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:30,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:30,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:30,406 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:30,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:30,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:30,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:30,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:30,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:30,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:30,408 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:30,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:30,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:30,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:30,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:30,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:30,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:30,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:30,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:30,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:30,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:30,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:30,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:30,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:30,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:30,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:30,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:30,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:30,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:30,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:30,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:30,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:30,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:30,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:30,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:30,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:30,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:30,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:30,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:30,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:30,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:30,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:30,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:30,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:30,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:30,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:30,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:30,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:30,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:30,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:30,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:30,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:30,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:30,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:30,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:30,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:30,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:30,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:30,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:30,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:30,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:30,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:30,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:30,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:30,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:30,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:30,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:30,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:30,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:30,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:30,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:30,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:30,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:30,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:30,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:30,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:30,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:30,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:30,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:30,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:30,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:30,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:30,433 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1018217361_0032
2015-02-10 19:08:30,450 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1018217361/.staging/job_local1018217361_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,451 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1018217361/.staging/job_local1018217361_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:30,493 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1018217361_0032/job_local1018217361_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,494 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1018217361_0032/job_local1018217361_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:30,495 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:30,496 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1018217361_0032
2015-02-10 19:08:30,496 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:30,496 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:30,496 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:30,499 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:30,499 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1018217361_0032_m_000000_0
2015-02-10 19:08:30,500 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:30,501 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:30,502 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2feea189
2015-02-10 19:08:30,503 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:30,503 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:30,520 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:30,521 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:30,521 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:30,521 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:30,521 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:30,522 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:30,522 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,528 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,531 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,531 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:30,531 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:30,531 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:30,531 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:30,534 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:30,536 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1018217361_0032_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:30,538 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:30,538 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1018217361_0032_m_000000_0' done.
2015-02-10 19:08:30,538 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1018217361_0032_m_000000_0
2015-02-10 19:08:30,538 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:30,542 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:30,543 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:30,544 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:30,544 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:30,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,549 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,549 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-10 19:08:30,558 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,560 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1018217361_0032
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,568 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1018217361_0032 state at FAILED
2015-02-10 19:08:30,583 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:30,584 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:30,584 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:30,588 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:30,589 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-10 19:08:30,589 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:30,590 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL/_temporary
2015-02-10 19:08:30,590 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL
2015-02-10 19:08:30,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:30,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:30,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:30,606 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:30,606 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:30,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:30,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:30,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:30,617 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:30,617 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,617 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-10 19:08:30,618 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:30,618 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:30,619 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:30,620 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_REPLACE
2015-02-10 19:08:30,621 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,622 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:30,646 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:30,666 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:30,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:30,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:30,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:30,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:30,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:30,676 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:30,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:30,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:30,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:30,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:30,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:30,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:30,678 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:30,679 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:30,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:30,681 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:30,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:30,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:30,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:30,682 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:30,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:30,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:30,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:30,683 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:30,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:30,685 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:30,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:30,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:30,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:30,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:30,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:30,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:30,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:30,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:30,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:30,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:30,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:30,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:30,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:30,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:30,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:30,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:30,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:30,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:30,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:30,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:30,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:30,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:30,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:30,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:30,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:30,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:30,692 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:30,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:30,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:30,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:30,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:30,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:30,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:30,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:30,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:30,695 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:30,695 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:30,695 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:30,696 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:30,696 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:30,696 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:30,696 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:30,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:30,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:30,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:30,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:30,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:30,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:30,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:30,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:30,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:30,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:30,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:30,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:30,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:30,700 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:30,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:30,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:30,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:30,701 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:30,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:30,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:30,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:30,702 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:30,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:30,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:30,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:30,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:30,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:30,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:30,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:30,704 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:30,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:30,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:30,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:30,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:30,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:30,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:30,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:30,711 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local590737697_0033
2015-02-10 19:08:30,727 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity590737697/.staging/job_local590737697_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,731 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity590737697/.staging/job_local590737697_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:30,774 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local590737697_0033/job_local590737697_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,774 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local590737697_0033/job_local590737697_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:30,776 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:30,776 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local590737697_0033
2015-02-10 19:08:30,776 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:30,777 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:30,777 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:30,780 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:30,780 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local590737697_0033_m_000000_0
2015-02-10 19:08:30,781 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:30,783 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:30,783 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@41302aea
2015-02-10 19:08:30,784 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:30,784 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:30,802 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:30,803 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:30,803 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:30,803 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:30,803 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:30,804 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:30,805 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,810 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,810 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,815 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,815 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:30,815 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:30,815 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:30,815 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:30,818 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:30,820 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local590737697_0033_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:30,821 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:30,821 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local590737697_0033_m_000000_0' done.
2015-02-10 19:08:30,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local590737697_0033_m_000000_0
2015-02-10 19:08:30,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:30,826 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:30,827 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:30,827 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:30,827 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:30,828 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:30,828 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:30,832 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:30,832 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-10 19:08:30,840 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,845 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local590737697_0033
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:30,848 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local590737697_0033 state at FAILED
2015-02-10 19:08:30,849 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:30,849 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:30,849 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:30,854 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:30,854 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_REPLACE
2015-02-10 19:08:30,854 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:30,855 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE/_temporary
2015-02-10 19:08:30,855 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE
2015-02-10 19:08:30,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:30,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:30,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:30,871 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:30,871 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:30,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:30,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:30,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:30,882 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:30,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:30,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-10 19:08:30,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:30,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:30,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:30,884 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-10 19:08:30,884 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,885 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:30,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:30,909 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:30,927 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:30,938 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:30,938 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:30,938 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:30,938 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:30,938 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:30,939 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:30,940 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:30,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:30,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:30,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:30,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:30,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:30,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:30,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:30,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:30,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:30,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:30,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:30,943 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:30,944 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:30,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:30,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:30,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:30,948 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:30,948 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:30,948 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:30,948 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:30,948 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:30,948 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:30,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:30,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:30,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:30,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:30,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:30,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:30,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:30,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:30,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:30,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:30,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:30,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:30,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:30,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:30,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:30,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:30,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:30,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:30,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:30,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:30,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:30,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:30,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:30,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:30,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:30,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:30,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:30,963 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local489147182_0034
2015-02-10 19:08:30,979 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity489147182/.staging/job_local489147182_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:30,980 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity489147182/.staging/job_local489147182_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:31,022 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local489147182_0034/job_local489147182_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:31,023 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local489147182_0034/job_local489147182_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:31,024 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:31,024 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local489147182_0034
2015-02-10 19:08:31,024 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:31,025 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:31,025 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:31,028 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:31,028 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local489147182_0034_m_000000_0
2015-02-10 19:08:31,030 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:31,031 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:31,031 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3d3d2941
2015-02-10 19:08:31,032 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:31,032 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:31,058 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:31,058 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:31,059 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:31,059 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:31,059 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:31,060 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:31,060 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:31,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:31,067 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:31,070 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,071 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:31,071 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:31,071 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:31,071 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:31,074 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:31,076 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local489147182_0034_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:31,078 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:31,078 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local489147182_0034_m_000000_0' done.
2015-02-10 19:08:31,078 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local489147182_0034_m_000000_0
2015-02-10 19:08:31,079 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:31,083 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:31,083 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:31,084 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:31,084 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,084 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:31,084 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:31,089 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:31,089 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-10 19:08:31,097 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:31,099 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local489147182_0034
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:31,109 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local489147182_0034 state at FAILED
2015-02-10 19:08:31,109 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:31,109 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:31,109 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:31,113 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:31,114 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-10 19:08:31,115 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:31,115 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP/_temporary
2015-02-10 19:08:31,116 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP
2015-02-10 19:08:31,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:31,131 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:31,132 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:31,132 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:31,137 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:31,139 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:31,140 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:31,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:31,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:31,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-10 19:08:31,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:31,143 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:31,144 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:31,144 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...ssemblyplatform/0_ARGS_-1
2015-02-10 19:08:31,145 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:31,146 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:31,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:31,170 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,188 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:31,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:31,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:31,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:31,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:31,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:31,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:31,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:31,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:31,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:31,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:31,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:31,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:31,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:31,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:31,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:31,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:31,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:31,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:31,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:31,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:31,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:31,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:31,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:31,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:31,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:31,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:31,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:31,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:31,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:31,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:31,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:31,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:31,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:31,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:31,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:31,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:31,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:31,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:31,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:31,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:31,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:31,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:31,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:31,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:31,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:31,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:31,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:31,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:31,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:31,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:31,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:31,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:31,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:31,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:31,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:31,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:31,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:31,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:31,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:31,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:31,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:31,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:31,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:31,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:31,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:31,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:31,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:31,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:31,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:31,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:31,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:31,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:31,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:31,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:31,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:31,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:31,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:31,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:31,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:31,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:31,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:31,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:31,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:31,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:31,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:31,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:31,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:31,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:31,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:31,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:31,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:31,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:31,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:31,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:31,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:31,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:31,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:31,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:31,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:31,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:31,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:31,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:31,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:31,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:31,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:31,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:31,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:31,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:31,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:31,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:31,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:31,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:31,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:31,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:31,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:31,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:31,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:31,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:31,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:31,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:31,236 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1921022523_0035
2015-02-10 19:08:31,252 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1921022523/.staging/job_local1921022523_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:31,253 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1921022523/.staging/job_local1921022523_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:31,296 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1921022523_0035/job_local1921022523_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:31,296 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1921022523_0035/job_local1921022523_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:31,297 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:31,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:31,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:31,298 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1921022523_0035
2015-02-10 19:08:31,299 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:31,301 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:31,301 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1921022523_0035_m_000000_0
2015-02-10 19:08:31,303 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:31,305 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:31,305 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6f0ac4be
2015-02-10 19:08:31,307 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:31,307 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:31,326 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:31,326 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:31,326 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:31,326 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:31,326 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:31,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:31,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:31,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:31,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:31,337 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,337 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:31,337 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:31,338 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:31,338 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:31,340 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:31,342 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1921022523_0035_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:31,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:31,344 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1921022523_0035_m_000000_0' done.
2015-02-10 19:08:31,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1921022523_0035_m_000000_0
2015-02-10 19:08:31,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:31,349 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:31,349 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:31,350 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:31,350 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,350 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:31,351 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:31,356 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:31,356 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-10 19:08:31,376 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1921022523_0035_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:31,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,378 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1921022523_0035_r_000000_0 is allowed to commit now
2015-02-10 19:08:31,380 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1921022523_0035_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary/0/task_local1921022523_0035_r_000000
2015-02-10 19:08:31,381 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:31,381 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1921022523_0035_r_000000_0' done.
2015-02-10 19:08:31,396 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary
2015-02-10 19:08:31,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:31,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:31,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:31,409 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:31,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:31,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:31,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:31,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:31,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:31,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:31,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:31,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:31,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:31,411 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:31,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:31,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:31,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:31,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:31,412 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:31,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:31,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:31,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:31,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:31,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:31,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:31,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:31,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:31,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:31,414 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:31,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:31,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:31,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:31,415 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:31,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:31,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:31,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:31,416 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:31,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:31,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:31,417 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:31,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:31,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:31,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:31,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:31,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:31,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:31,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:31,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:31,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:31,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:31,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:31,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:31,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:31,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:31,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:31,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:31,423 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:31,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:31,424 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:31,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:31,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:31,425 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:31,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:31,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:31,426 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:31,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:31,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:31,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:31,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:31,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:31,428 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:31,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:31,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:31,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:31,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:31,430 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:31,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:31,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:31,431 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:31,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:31,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:31,432 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:31,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:31,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:31,433 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:31,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:31,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:31,434 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:31,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:31,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:31,435 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:31,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:31,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:31,436 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:31,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:31,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:31,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:31,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:31,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:31,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:31,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:31,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:31,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:31,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:31,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:31,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:31,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:31,441 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:31,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:31,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:31,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:31,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:31,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:31,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:31,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:31,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:31,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:31,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:31,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:31,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:31,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:31,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:31,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,464 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,480 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,495 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,496 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1
2015-02-10 19:08:31,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,511 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:31,512 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:31,516 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_'field'
2015-02-10 19:08:31,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,531 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:31,531 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:31,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:31,542 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:31,543 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:31,543 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-10 19:08:31,543 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:31,543 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:31,543 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:31,544 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_RESULTS
2015-02-10 19:08:31,544 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:31,545 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:31,571 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:31,572 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,589 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:31,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:31,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:31,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:31,599 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:31,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:31,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:31,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:31,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:31,600 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:31,606 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1765713838_0036
2015-02-10 19:08:31,622 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1765713838/.staging/job_local1765713838_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:31,623 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1765713838/.staging/job_local1765713838_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:31,665 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1765713838_0036/job_local1765713838_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:31,665 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1765713838_0036/job_local1765713838_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:31,667 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:31,667 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:31,667 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1765713838_0036
2015-02-10 19:08:31,667 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:31,667 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:31,670 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:31,670 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1765713838_0036_m_000000_0
2015-02-10 19:08:31,672 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:31,674 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:31,674 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@222661f8
2015-02-10 19:08:31,675 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:31,676 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:31,694 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:31,695 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:31,695 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:31,695 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:31,695 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:31,697 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:31,697 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:31,702 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:31,702 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:31,706 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,706 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:31,706 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:31,706 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:31,706 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:31,709 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:31,711 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1765713838_0036_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:31,713 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:31,713 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1765713838_0036_m_000000_0' done.
2015-02-10 19:08:31,713 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1765713838_0036_m_000000_0
2015-02-10 19:08:31,714 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:31,718 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:31,718 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:31,719 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:31,719 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,719 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:31,720 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:31,724 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:31,724 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-10 19:08:31,737 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1765713838_0036_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:31,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:31,740 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1765713838_0036_r_000000_0 is allowed to commit now
2015-02-10 19:08:31,741 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1765713838_0036_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary/0/task_local1765713838_0036_r_000000
2015-02-10 19:08:31,744 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:31,744 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1765713838_0036_r_000000_0' done.
2015-02-10 19:08:31,765 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary
2015-02-10 19:08:31,777 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:31,778 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:31,778 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:31,778 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:31,778 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:31,778 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:31,779 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:31,779 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:31,779 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:31,779 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:31,780 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:31,780 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:31,780 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:31,780 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:31,780 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:31,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:31,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:31,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:31,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:31,781 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:31,782 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:31,782 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:31,782 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:31,782 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:31,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:31,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:31,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:31,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:31,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:31,784 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:31,784 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,784 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:31,784 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:31,784 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:31,785 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:31,785 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:31,785 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:31,785 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:31,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:31,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:31,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:31,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:31,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:31,787 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:31,787 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:31,787 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:31,787 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:31,787 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:31,788 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:31,788 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:31,788 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:31,788 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:31,789 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:31,789 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:31,789 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:31,789 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:31,789 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:31,790 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,790 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:31,790 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:31,790 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:31,791 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:31,791 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:31,791 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:31,791 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:31,791 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:31,792 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:31,792 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:31,792 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:31,792 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:31,792 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:31,793 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:31,793 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:31,793 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:31,794 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:31,794 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:31,794 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:31,795 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:31,795 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:31,795 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:31,796 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:31,796 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:31,796 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:31,797 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:31,797 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:31,797 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:31,798 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:31,798 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:31,798 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:31,798 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:31,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:31,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:31,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:31,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:31,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:31,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:31,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:31,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:31,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:31,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:31,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:31,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:31,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:31,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:31,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:31,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:31,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:31,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:31,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:31,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:31,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:31,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:31,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:31,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:31,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:31,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:31,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:31,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:31,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:31,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:31,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:31,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:31,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:31,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:31,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,824 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,855 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,856 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS
2015-02-10 19:08:31,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,872 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:31,872 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:31,876 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_ALL
2015-02-10 19:08:31,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:31,892 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:31,892 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:31,897 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:31,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:31,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:31,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-10 19:08:31,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:31,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:31,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:31,904 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_REPLACE
2015-02-10 19:08:31,905 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:31,906 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:31,929 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:31,930 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:31,951 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:31,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:31,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:31,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:31,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:31,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:31,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:31,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:31,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:31,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:31,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:31,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:31,970 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local320573825_0037
2015-02-10 19:08:31,987 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity320573825/.staging/job_local320573825_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:31,988 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity320573825/.staging/job_local320573825_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:32,034 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local320573825_0037/job_local320573825_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:32,034 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local320573825_0037/job_local320573825_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:32,036 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:32,036 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local320573825_0037
2015-02-10 19:08:32,037 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:32,037 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:32,037 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:32,041 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:32,042 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local320573825_0037_m_000000_0
2015-02-10 19:08:32,043 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:32,045 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:32,045 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7ea88b1c
2015-02-10 19:08:32,046 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:32,046 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:32,073 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:32,073 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:32,074 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:32,074 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:32,074 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:32,076 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:32,076 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:32,081 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:32,081 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:32,084 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,085 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:32,085 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:32,085 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:32,085 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:32,088 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:32,090 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local320573825_0037_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:32,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:32,092 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local320573825_0037_m_000000_0' done.
2015-02-10 19:08:32,092 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local320573825_0037_m_000000_0
2015-02-10 19:08:32,092 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:32,098 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:32,099 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:32,099 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:32,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:32,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:32,105 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:32,105 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-10 19:08:32,120 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local320573825_0037_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:32,121 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,122 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local320573825_0037_r_000000_0 is allowed to commit now
2015-02-10 19:08:32,122 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local320573825_0037_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary/0/task_local320573825_0037_r_000000
2015-02-10 19:08:32,123 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:32,123 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local320573825_0037_r_000000_0' done.
2015-02-10 19:08:32,138 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary
2015-02-10 19:08:32,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:32,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:32,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:32,152 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:32,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:32,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:32,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:32,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:32,153 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:32,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:32,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:32,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:32,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:32,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:32,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:32,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:32,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:32,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:32,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:32,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:32,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:32,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:32,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:32,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:32,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:32,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:32,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:32,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:32,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:32,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:32,162 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:32,163 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:32,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:32,164 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:32,165 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:32,165 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:32,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:32,166 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:32,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:32,167 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:32,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:32,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:32,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:32,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:32,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:32,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:32,170 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:32,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:32,171 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:32,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:32,172 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:32,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:32,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:32,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:32,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:32,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:32,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:32,176 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:32,176 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:32,177 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:32,177 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:32,178 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:32,178 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:32,179 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:32,179 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:32,179 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:32,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:32,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:32,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:32,181 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:32,182 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:32,182 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:32,183 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:32,183 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:32,184 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:32,184 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:32,184 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:32,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:32,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:32,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:32,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:32,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:32,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:32,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:32,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:32,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:32,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:32,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:32,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:32,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:32,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:32,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:32,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:32,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:32,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:32,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:32,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:32,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:32,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:32,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:32,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:32,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:32,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:32,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:32,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:32,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:32,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:32,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:32,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:32,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:32,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:32,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:32,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:32,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:32,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:32,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:32,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:32,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:32,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:32,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:32,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:32,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:32,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,219 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,248 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,250 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE
2015-02-10 19:08:32,265 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,266 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:32,267 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:32,272 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:32,277 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:32,277 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:32,278 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-10 19:08:32,278 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:32,278 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:32,278 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:32,279 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_ARGS_SWAP
2015-02-10 19:08:32,279 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:32,280 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:32,303 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:32,304 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,322 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:32,331 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:32,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:32,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:32,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:32,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:32,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:32,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:32,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:32,334 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:32,339 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1904761152_0038
2015-02-10 19:08:32,355 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1904761152/.staging/job_local1904761152_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:32,356 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1904761152/.staging/job_local1904761152_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:32,398 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1904761152_0038/job_local1904761152_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:32,398 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1904761152_0038/job_local1904761152_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:32,400 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:32,400 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1904761152_0038
2015-02-10 19:08:32,400 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:32,401 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:32,401 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:32,403 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:32,404 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1904761152_0038_m_000000_0
2015-02-10 19:08:32,405 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:32,406 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:32,406 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@15e4da62
2015-02-10 19:08:32,408 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:32,408 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:32,434 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:32,434 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:32,434 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:32,435 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:32,435 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:32,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:32,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:32,441 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:32,441 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:32,445 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,445 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:32,445 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:32,445 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:32,445 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:32,448 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:32,449 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1904761152_0038_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:32,451 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:32,451 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1904761152_0038_m_000000_0' done.
2015-02-10 19:08:32,451 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1904761152_0038_m_000000_0
2015-02-10 19:08:32,451 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:32,455 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:32,456 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:32,456 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:32,457 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,457 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:32,457 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:32,462 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:32,462 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-10 19:08:32,473 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1904761152_0038_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:32,474 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,474 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1904761152_0038_r_000000_0 is allowed to commit now
2015-02-10 19:08:32,475 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1904761152_0038_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary/0/task_local1904761152_0038_r_000000
2015-02-10 19:08:32,476 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:32,476 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1904761152_0038_r_000000_0' done.
2015-02-10 19:08:32,499 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary
2015-02-10 19:08:32,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:32,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:32,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:32,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:32,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:32,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:32,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:32,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:32,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:32,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:32,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:32,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:32,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:32,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:32,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:32,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:32,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:32,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:32,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:32,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:32,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:32,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:32,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:32,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:32,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:32,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:32,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:32,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:32,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:32,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:32,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:32,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:32,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:32,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:32,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:32,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:32,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:32,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:32,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:32,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:32,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:32,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:32,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:32,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:32,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:32,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:32,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:32,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:32,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:32,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:32,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:32,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:32,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:32,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:32,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:32,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:32,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:32,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:32,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:32,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:32,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:32,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:32,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:32,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:32,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:32,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:32,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:32,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:32,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:32,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:32,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:32,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:32,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:32,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:32,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:32,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:32,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:32,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:32,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:32,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:32,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:32,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:32,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:32,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:32,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:32,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:32,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:32,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:32,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:32,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:32,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:32,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:32,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:32,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:32,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:32,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:32,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:32,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:32,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:32,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:32,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:32,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:32,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:32,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:32,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:32,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:32,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:32,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:32,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:32,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:32,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:32,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:32,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:32,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:32,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:32,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:32,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:32,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:32,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:32,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:32,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:32,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:32,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,553 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,569 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,582 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,583 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP
2015-02-10 19:08:32,598 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,599 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:32,600 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:32,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:32,611 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:32,611 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:32,611 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-10 19:08:32,611 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:32,611 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:32,611 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:32,613 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_'field'_-1
2015-02-10 19:08:32,614 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:32,615 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:32,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:32,638 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,679 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:32,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:32,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:32,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:32,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:32,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:32,689 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:32,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:32,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:32,690 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:32,696 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local864837335_0039
2015-02-10 19:08:32,711 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity864837335/.staging/job_local864837335_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:32,712 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity864837335/.staging/job_local864837335_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:32,754 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local864837335_0039/job_local864837335_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:32,754 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local864837335_0039/job_local864837335_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:32,755 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:32,756 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local864837335_0039
2015-02-10 19:08:32,756 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:32,756 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:32,756 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:32,758 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:32,759 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local864837335_0039_m_000000_0
2015-02-10 19:08:32,760 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:32,761 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:32,761 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@600d9a60
2015-02-10 19:08:32,762 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:32,763 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:32,789 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:32,790 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:32,790 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:32,790 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:32,790 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:32,791 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:32,793 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:32,798 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:32,798 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:32,801 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,802 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:32,802 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:32,802 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:32,802 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:32,805 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:32,807 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local864837335_0039_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:32,809 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:32,810 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local864837335_0039_m_000000_0' done.
2015-02-10 19:08:32,810 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local864837335_0039_m_000000_0
2015-02-10 19:08:32,810 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:32,814 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:32,816 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:32,816 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:32,817 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,817 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:32,817 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:32,823 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:32,823 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-10 19:08:32,834 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local864837335_0039_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:32,836 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:32,836 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local864837335_0039_r_000000_0 is allowed to commit now
2015-02-10 19:08:32,837 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local864837335_0039_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary/0/task_local864837335_0039_r_000000
2015-02-10 19:08:32,838 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:32,838 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local864837335_0039_r_000000_0' done.
2015-02-10 19:08:32,854 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary
2015-02-10 19:08:32,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:32,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:32,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:32,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:32,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:32,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:32,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:32,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:32,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:32,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:32,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:32,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:32,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:32,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:32,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:32,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:32,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:32,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:32,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:32,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:32,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:32,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:32,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:32,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:32,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:32,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:32,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:32,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:32,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:32,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:32,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:32,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:32,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:32,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:32,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:32,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:32,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:32,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:32,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:32,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:32,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:32,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:32,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:32,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:32,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:32,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:32,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:32,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:32,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:32,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:32,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:32,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:32,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:32,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:32,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:32,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:32,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:32,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:32,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:32,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:32,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:32,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:32,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:32,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:32,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:32,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:32,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:32,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:32,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:32,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:32,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:32,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:32,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:32,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:32,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:32,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:32,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:32,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:32,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:32,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:32,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:32,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:32,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:32,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:32,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:32,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:32,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:32,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:32,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:32,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:32,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:32,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:32,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:32,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:32,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:32,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:32,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:32,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:32,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:32,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:32,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:32,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:32,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:32,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:32,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:32,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:32,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:32,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:32,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:32,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:32,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:32,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:32,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:32,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:32,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:32,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:32,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:32,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:32,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:32,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:32,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:32,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:32,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,911 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:32,927 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:32,941 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:32,942 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1
2015-02-10 19:08:32,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:32,958 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:32,958 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:32,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:32,968 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:32,969 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:32,969 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-10 19:08:32,969 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:32,970 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:32,970 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:32,970 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_'field'
2015-02-10 19:08:32,971 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:32,972 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:32,994 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:32,995 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,013 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:33,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:33,022 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:33,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:33,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:33,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:33,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:33,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:33,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:33,024 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:33,030 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1364258893_0040
2015-02-10 19:08:33,045 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1364258893/.staging/job_local1364258893_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:33,046 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1364258893/.staging/job_local1364258893_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:33,087 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1364258893_0040/job_local1364258893_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:33,087 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1364258893_0040/job_local1364258893_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:33,088 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:33,088 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1364258893_0040
2015-02-10 19:08:33,089 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:33,089 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:33,089 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:33,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:33,092 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1364258893_0040_m_000000_0
2015-02-10 19:08:33,093 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:33,094 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:33,094 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@73f647ce
2015-02-10 19:08:33,095 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:33,095 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:33,121 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:33,121 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:33,121 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:33,121 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:33,121 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:33,122 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:33,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:33,127 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:33,127 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:33,130 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,130 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:33,131 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:33,131 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:33,131 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:33,133 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:33,135 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1364258893_0040_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:33,137 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:33,137 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1364258893_0040_m_000000_0' done.
2015-02-10 19:08:33,137 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1364258893_0040_m_000000_0
2015-02-10 19:08:33,137 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:33,142 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:33,143 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:33,143 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:33,143 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,144 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:33,144 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:33,148 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:33,149 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-10 19:08:33,160 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1364258893_0040_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:33,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,162 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1364258893_0040_r_000000_0 is allowed to commit now
2015-02-10 19:08:33,162 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1364258893_0040_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary/0/task_local1364258893_0040_r_000000
2015-02-10 19:08:33,163 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:33,163 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1364258893_0040_r_000000_0' done.
2015-02-10 19:08:33,175 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary
2015-02-10 19:08:33,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:33,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:33,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:33,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:33,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:33,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:33,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:33,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:33,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:33,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:33,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:33,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:33,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:33,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:33,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:33,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:33,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:33,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:33,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:33,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:33,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:33,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:33,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:33,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:33,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:33,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:33,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:33,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:33,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:33,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:33,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:33,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:33,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:33,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:33,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:33,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:33,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:33,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:33,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:33,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:33,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:33,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:33,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:33,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:33,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:33,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:33,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:33,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:33,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:33,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:33,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:33,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:33,205 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:33,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:33,206 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:33,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:33,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:33,207 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:33,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:33,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:33,208 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:33,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:33,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:33,209 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:33,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:33,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:33,210 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:33,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:33,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:33,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:33,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:33,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:33,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:33,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:33,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:33,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:33,212 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:33,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:33,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:33,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:33,214 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:33,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:33,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:33,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:33,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:33,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:33,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:33,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:33,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:33,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:33,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:33,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:33,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:33,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:33,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:33,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:33,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:33,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:33,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:33,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:33,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:33,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:33,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:33,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:33,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:33,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:33,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:33,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:33,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:33,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:33,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:33,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:33,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:33,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:33,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:33,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:33,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:33,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:33,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:33,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:33,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:33,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:33,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,242 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,258 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,271 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,272 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'
2015-02-10 19:08:33,286 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,287 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:33,288 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:33,294 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:33,299 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:33,299 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:33,299 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-10 19:08:33,300 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:33,300 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:33,300 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:33,301 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_RESULTS
2015-02-10 19:08:33,301 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:33,302 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:33,325 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:33,326 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,344 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:33,353 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:33,353 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:33,354 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,354 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:33,354 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:33,354 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:33,354 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:33,354 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:33,355 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,355 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:33,355 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:33,360 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local249377067_0041
2015-02-10 19:08:33,376 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity249377067/.staging/job_local249377067_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:33,377 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity249377067/.staging/job_local249377067_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:33,418 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local249377067_0041/job_local249377067_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:33,418 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local249377067_0041/job_local249377067_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:33,419 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:33,419 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local249377067_0041
2015-02-10 19:08:33,419 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:33,419 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:33,420 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:33,422 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:33,422 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local249377067_0041_m_000000_0
2015-02-10 19:08:33,423 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:33,425 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:33,425 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@57fb85a1
2015-02-10 19:08:33,426 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:33,426 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:33,453 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:33,454 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:33,454 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:33,454 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:33,454 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:33,455 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:33,455 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:33,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:33,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:33,464 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,464 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:33,464 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:33,464 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:33,465 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:33,467 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:33,469 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local249377067_0041_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:33,471 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:33,471 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local249377067_0041_m_000000_0' done.
2015-02-10 19:08:33,471 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local249377067_0041_m_000000_0
2015-02-10 19:08:33,471 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:33,475 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:33,476 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:33,476 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:33,477 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,477 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:33,477 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:33,481 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:33,481 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-10 19:08:33,492 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local249377067_0041_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:33,493 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,493 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local249377067_0041_r_000000_0 is allowed to commit now
2015-02-10 19:08:33,494 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local249377067_0041_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary/0/task_local249377067_0041_r_000000
2015-02-10 19:08:33,498 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:33,498 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local249377067_0041_r_000000_0' done.
2015-02-10 19:08:33,518 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary
2015-02-10 19:08:33,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:33,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:33,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:33,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:33,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:33,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:33,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:33,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:33,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:33,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:33,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:33,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:33,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:33,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:33,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:33,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:33,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:33,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:33,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:33,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:33,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:33,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:33,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:33,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:33,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:33,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:33,536 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:33,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:33,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:33,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:33,537 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:33,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:33,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:33,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:33,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:33,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:33,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:33,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:33,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:33,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:33,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:33,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:33,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:33,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:33,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:33,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:33,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:33,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:33,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:33,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:33,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:33,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:33,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:33,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:33,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:33,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:33,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:33,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:33,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:33,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:33,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:33,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:33,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:33,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:33,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:33,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:33,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:33,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:33,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:33,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:33,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:33,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:33,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:33,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:33,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:33,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:33,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:33,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:33,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:33,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:33,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:33,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:33,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:33,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:33,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:33,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:33,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:33,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:33,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:33,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:33,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:33,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:33,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:33,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:33,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:33,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:33,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:33,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:33,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:33,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:33,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:33,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:33,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:33,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:33,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:33,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:33,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:33,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:33,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:33,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:33,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:33,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:33,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:33,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:33,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:33,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:33,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:33,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:33,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:33,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:33,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:33,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:33,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,573 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,590 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,591 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,591 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,605 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,606 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS
2015-02-10 19:08:33,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,621 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:33,621 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:33,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:33,631 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-10 19:08:33,631 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:33,632 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:33,632 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:33,633 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_'field'_ALL
2015-02-10 19:08:33,634 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:33,635 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:33,657 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:33,658 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,676 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:33,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:33,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:33,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,686 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:33,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:33,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:33,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:33,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:33,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,687 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:33,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:33,693 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local924932842_0042
2015-02-10 19:08:33,709 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity924932842/.staging/job_local924932842_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:33,710 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity924932842/.staging/job_local924932842_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:33,751 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local924932842_0042/job_local924932842_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:33,751 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local924932842_0042/job_local924932842_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:33,752 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:33,753 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local924932842_0042
2015-02-10 19:08:33,753 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:33,753 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:33,753 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:33,755 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:33,756 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local924932842_0042_m_000000_0
2015-02-10 19:08:33,757 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:33,758 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:33,758 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@43b3cd5
2015-02-10 19:08:33,759 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:33,760 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:33,786 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:33,786 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:33,786 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:33,786 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:33,786 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:33,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:33,788 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:33,792 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:33,792 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:33,795 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,796 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:33,796 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:33,796 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:33,796 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:33,799 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:33,800 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local924932842_0042_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:33,802 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:33,802 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local924932842_0042_m_000000_0' done.
2015-02-10 19:08:33,802 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local924932842_0042_m_000000_0
2015-02-10 19:08:33,802 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:33,806 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:33,807 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:33,807 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:33,808 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,808 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:33,808 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:33,812 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:33,812 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-10 19:08:33,824 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local924932842_0042_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:33,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:33,825 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local924932842_0042_r_000000_0 is allowed to commit now
2015-02-10 19:08:33,825 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local924932842_0042_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary/0/task_local924932842_0042_r_000000
2015-02-10 19:08:33,826 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:33,827 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local924932842_0042_r_000000_0' done.
2015-02-10 19:08:33,840 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary
2015-02-10 19:08:33,853 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:33,854 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:33,854 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:33,854 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:33,854 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:33,854 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:33,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:33,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:33,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:33,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:33,856 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:33,856 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:33,856 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:33,856 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:33,856 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:33,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:33,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:33,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:33,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:33,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:33,858 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:33,858 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:33,858 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:33,858 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:33,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:33,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:33,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:33,860 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:33,860 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:33,860 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:33,861 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,861 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:33,861 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:33,861 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:33,862 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:33,862 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:33,862 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:33,863 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:33,863 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:33,863 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:33,864 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:33,864 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:33,864 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:33,865 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:33,865 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:33,865 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:33,866 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:33,866 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:33,866 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:33,866 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:33,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:33,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:33,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:33,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:33,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:33,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:33,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:33,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,869 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:33,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:33,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:33,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:33,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:33,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:33,871 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:33,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:33,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:33,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:33,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:33,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:33,873 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:33,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:33,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:33,874 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:33,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:33,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:33,875 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:33,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:33,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:33,876 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:33,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:33,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:33,877 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:33,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:33,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:33,878 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:33,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:33,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:33,879 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:33,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:33,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:33,880 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:33,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:33,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:33,881 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:33,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:33,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:33,882 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:33,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:33,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:33,883 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:33,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:33,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:33,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:33,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:33,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:33,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:33,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:33,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:33,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:33,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:33,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:33,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:33,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:33,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:33,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:33,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:33,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:33,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:33,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:33,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:33,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:33,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:33,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:33,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,906 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:33,922 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:33,936 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:33,938 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL
2015-02-10 19:08:33,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,952 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:33,952 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:33,956 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_REPLACE
2015-02-10 19:08:33,970 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:33,971 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:33,971 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:33,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:33,980 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:33,981 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:33,981 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-10 19:08:33,981 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:33,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:33,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:33,983 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_'field'_SWAP
2015-02-10 19:08:33,983 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:33,984 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:34,007 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:34,008 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,026 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:34,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:34,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:34,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,036 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:34,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:34,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:34,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:34,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:34,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:34,038 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:34,043 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1323370332_0043
2015-02-10 19:08:34,059 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1323370332/.staging/job_local1323370332_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:34,060 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1323370332/.staging/job_local1323370332_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:34,103 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1323370332_0043/job_local1323370332_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:34,103 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1323370332_0043/job_local1323370332_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:34,104 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:34,104 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:34,104 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1323370332_0043
2015-02-10 19:08:34,105 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:34,105 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:34,107 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:34,107 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1323370332_0043_m_000000_0
2015-02-10 19:08:34,109 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:34,110 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:34,110 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@a220861
2015-02-10 19:08:34,112 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:34,112 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:34,138 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:34,138 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:34,138 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:34,139 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:34,139 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:34,141 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:34,141 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:34,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:34,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:34,150 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,150 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:34,150 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:34,150 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:34,150 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:34,153 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:34,155 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1323370332_0043_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:34,156 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:34,157 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1323370332_0043_m_000000_0' done.
2015-02-10 19:08:34,157 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1323370332_0043_m_000000_0
2015-02-10 19:08:34,157 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:34,160 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:34,161 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:34,161 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:34,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,162 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:34,162 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:34,166 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:34,166 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-10 19:08:34,177 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1323370332_0043_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:34,179 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,179 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1323370332_0043_r_000000_0 is allowed to commit now
2015-02-10 19:08:34,179 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1323370332_0043_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary/0/task_local1323370332_0043_r_000000
2015-02-10 19:08:34,181 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:34,181 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1323370332_0043_r_000000_0' done.
2015-02-10 19:08:34,203 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary
2015-02-10 19:08:34,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:34,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:34,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:34,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:34,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:34,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:34,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:34,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:34,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:34,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:34,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:34,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:34,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:34,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:34,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:34,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:34,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:34,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:34,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:34,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:34,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:34,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:34,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:34,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:34,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:34,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:34,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:34,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:34,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:34,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:34,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:34,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:34,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:34,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:34,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:34,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:34,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:34,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:34,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:34,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:34,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:34,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:34,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:34,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:34,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:34,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:34,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:34,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:34,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:34,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:34,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:34,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:34,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:34,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:34,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:34,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:34,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:34,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:34,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:34,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:34,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:34,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:34,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:34,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:34,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:34,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:34,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:34,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:34,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:34,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:34,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:34,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:34,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:34,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:34,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:34,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:34,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:34,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:34,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:34,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:34,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:34,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:34,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:34,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:34,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:34,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:34,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:34,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:34,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:34,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:34,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:34,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:34,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:34,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:34,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:34,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:34,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:34,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:34,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:34,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:34,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:34,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:34,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:34,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:34,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:34,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:34,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:34,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:34,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:34,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:34,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:34,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:34,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:34,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:34,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:34,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:34,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:34,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:34,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:34,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:34,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:34,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:34,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,256 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,272 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,272 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,273 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,287 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,288 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP
2015-02-10 19:08:34,302 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,303 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:34,304 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:34,308 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:34,312 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:34,313 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:34,313 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-10 19:08:34,313 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:34,313 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:34,313 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:34,314 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_UNKNOWN_-1
2015-02-10 19:08:34,314 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:34,315 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:34,338 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:34,338 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,356 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:34,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:34,365 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:34,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:34,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:34,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:34,366 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:34,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:34,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:34,367 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:34,373 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local359739974_0044
2015-02-10 19:08:34,388 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity359739974/.staging/job_local359739974_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:34,389 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity359739974/.staging/job_local359739974_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:34,431 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local359739974_0044/job_local359739974_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:34,431 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local359739974_0044/job_local359739974_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:34,432 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:34,432 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local359739974_0044
2015-02-10 19:08:34,432 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:34,432 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:34,432 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:34,435 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:34,435 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local359739974_0044_m_000000_0
2015-02-10 19:08:34,437 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:34,439 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:34,440 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@35fc8e8a
2015-02-10 19:08:34,442 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:34,442 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:34,470 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:34,471 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:34,471 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:34,471 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:34,472 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:34,474 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:34,474 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:34,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:34,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:34,483 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,483 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:34,483 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:34,483 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:34,483 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:34,486 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:34,487 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local359739974_0044_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:34,489 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:34,489 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local359739974_0044_m_000000_0' done.
2015-02-10 19:08:34,489 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local359739974_0044_m_000000_0
2015-02-10 19:08:34,489 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:34,493 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:34,494 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:34,494 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:34,495 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,495 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:34,495 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:34,498 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:34,498 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-10 19:08:34,510 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local359739974_0044_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:34,511 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,511 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local359739974_0044_r_000000_0 is allowed to commit now
2015-02-10 19:08:34,512 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local359739974_0044_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary/0/task_local359739974_0044_r_000000
2015-02-10 19:08:34,512 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:34,513 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local359739974_0044_r_000000_0' done.
2015-02-10 19:08:34,525 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary
2015-02-10 19:08:34,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:34,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:34,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:34,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:34,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:34,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:34,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:34,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:34,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:34,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:34,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:34,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:34,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:34,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:34,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:34,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:34,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:34,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:34,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:34,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:34,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:34,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:34,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:34,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:34,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:34,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:34,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:34,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:34,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:34,544 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:34,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:34,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:34,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:34,545 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:34,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:34,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:34,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:34,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:34,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:34,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:34,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:34,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:34,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:34,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:34,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:34,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:34,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:34,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:34,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:34,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:34,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:34,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:34,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:34,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:34,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:34,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:34,550 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:34,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:34,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:34,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:34,551 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:34,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:34,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:34,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:34,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:34,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:34,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:34,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:34,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:34,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:34,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:34,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:34,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:34,554 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:34,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:34,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:34,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:34,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:34,555 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:34,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:34,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:34,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:34,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:34,556 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:34,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:34,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:34,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:34,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:34,557 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:34,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:34,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:34,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:34,558 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:34,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:34,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:34,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:34,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:34,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:34,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:34,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:34,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:34,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:34,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:34,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:34,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:34,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:34,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:34,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:34,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:34,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:34,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:34,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:34,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:34,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:34,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:34,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:34,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:34,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:34,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:34,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:34,564 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:34,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:34,565 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,579 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,609 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,610 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1
2015-02-10 19:08:34,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,625 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:34,625 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:34,629 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_'field'
2015-02-10 19:08:34,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,643 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:34,644 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:34,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:34,653 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:34,653 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:34,653 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-10 19:08:34,654 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:34,654 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:34,654 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:34,654 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_RESULTS
2015-02-10 19:08:34,655 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:34,656 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:34,680 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:34,681 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,699 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:34,708 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:34,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:34,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:34,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:34,709 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:34,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:34,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:34,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:34,710 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:34,716 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local2064665005_0045
2015-02-10 19:08:34,732 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity2064665005/.staging/job_local2064665005_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:34,733 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity2064665005/.staging/job_local2064665005_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:34,776 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2064665005_0045/job_local2064665005_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:34,777 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2064665005_0045/job_local2064665005_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:34,778 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:34,778 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2064665005_0045
2015-02-10 19:08:34,778 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:34,778 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:34,779 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:34,781 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:34,781 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local2064665005_0045_m_000000_0
2015-02-10 19:08:34,783 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:34,785 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:34,785 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@60727ef5
2015-02-10 19:08:34,786 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:34,786 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:34,813 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:34,814 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:34,814 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:34,814 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:34,814 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:34,815 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:34,815 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:34,819 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:34,819 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:34,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,822 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:34,822 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:34,822 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:34,822 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:34,825 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:34,827 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2064665005_0045_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:34,828 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:34,829 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2064665005_0045_m_000000_0' done.
2015-02-10 19:08:34,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local2064665005_0045_m_000000_0
2015-02-10 19:08:34,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:34,833 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:34,833 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:34,834 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:34,834 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,834 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:34,835 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:34,838 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:34,838 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-10 19:08:34,849 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2064665005_0045_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:34,850 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:34,850 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local2064665005_0045_r_000000_0 is allowed to commit now
2015-02-10 19:08:34,851 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2064665005_0045_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary/0/task_local2064665005_0045_r_000000
2015-02-10 19:08:34,854 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:34,854 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2064665005_0045_r_000000_0' done.
2015-02-10 19:08:34,871 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary
2015-02-10 19:08:34,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:34,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:34,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:34,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:34,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:34,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:34,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:34,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:34,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:34,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:34,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:34,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:34,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:34,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:34,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:34,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:34,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:34,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:34,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:34,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:34,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:34,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:34,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:34,888 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:34,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:34,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:34,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:34,889 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:34,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:34,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:34,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:34,890 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:34,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:34,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:34,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:34,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:34,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:34,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:34,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:34,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:34,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:34,892 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:34,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:34,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:34,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:34,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:34,893 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:34,894 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:34,894 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:34,894 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:34,894 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:34,895 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:34,895 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:34,895 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:34,895 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:34,895 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:34,896 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,896 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:34,896 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:34,896 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:34,896 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:34,897 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:34,897 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:34,897 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:34,897 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:34,897 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:34,898 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:34,898 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:34,898 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:34,898 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:34,899 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:34,899 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:34,899 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:34,899 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:34,899 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:34,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:34,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:34,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:34,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:34,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:34,901 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:34,901 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:34,901 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:34,901 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:34,901 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:34,902 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:34,902 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:34,902 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:34,902 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:34,902 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:34,903 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:34,903 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:34,903 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:34,903 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:34,904 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:34,904 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:34,904 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:34,904 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:34,904 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:34,905 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:34,905 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:34,905 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:34,905 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:34,905 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:34,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:34,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:34,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:34,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:34,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:34,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:34,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:34,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:34,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:34,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:34,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:34,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:34,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:34,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:34,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:34,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:34,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:34,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:34,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:34,910 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,926 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,941 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:34,942 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:34,958 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:34,959 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS
2015-02-10 19:08:34,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:34,976 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:34,977 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:34,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:34,988 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:34,988 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:34,989 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-10 19:08:34,989 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:34,989 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:34,989 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:34,989 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_UNKNOWN_ALL
2015-02-10 19:08:34,990 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:34,992 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,017 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:35,018 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,036 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:35,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:35,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:35,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,046 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:35,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:35,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:35,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:35,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:35,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,047 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:35,048 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:35,053 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1663181946_0046
2015-02-10 19:08:35,068 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1663181946/.staging/job_local1663181946_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,069 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1663181946/.staging/job_local1663181946_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:35,110 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1663181946_0046/job_local1663181946_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,110 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1663181946_0046/job_local1663181946_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:35,111 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:35,112 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1663181946_0046
2015-02-10 19:08:35,112 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:35,112 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:35,112 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:35,115 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:35,115 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1663181946_0046_m_000000_0
2015-02-10 19:08:35,116 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:35,117 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:35,117 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2fa648b8
2015-02-10 19:08:35,119 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:35,119 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:35,144 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:35,144 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:35,144 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:35,144 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:35,144 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:35,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:35,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:35,149 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:35,149 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:35,152 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,152 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:35,153 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:35,153 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:35,153 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:35,156 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:35,157 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1663181946_0046_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:35,159 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:35,159 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1663181946_0046_m_000000_0' done.
2015-02-10 19:08:35,159 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1663181946_0046_m_000000_0
2015-02-10 19:08:35,159 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:35,163 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:35,164 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:35,164 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:35,164 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:35,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:35,168 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:35,168 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-10 19:08:35,180 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1663181946_0046_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:35,181 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,181 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1663181946_0046_r_000000_0 is allowed to commit now
2015-02-10 19:08:35,182 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1663181946_0046_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary/0/task_local1663181946_0046_r_000000
2015-02-10 19:08:35,183 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:35,183 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1663181946_0046_r_000000_0' done.
2015-02-10 19:08:35,202 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary
2015-02-10 19:08:35,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:35,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:35,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:35,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:35,215 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:35,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:35,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:35,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:35,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:35,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:35,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:35,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:35,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:35,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:35,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:35,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:35,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:35,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:35,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:35,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:35,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:35,220 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:35,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:35,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:35,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:35,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:35,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:35,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:35,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:35,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:35,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:35,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:35,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:35,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:35,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:35,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:35,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:35,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:35,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:35,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:35,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:35,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:35,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:35,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:35,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:35,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:35,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:35,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:35,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:35,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:35,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:35,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:35,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:35,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:35,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:35,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:35,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:35,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:35,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:35,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:35,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:35,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:35,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:35,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:35,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:35,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:35,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:35,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:35,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:35,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:35,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:35,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:35,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:35,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:35,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:35,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:35,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:35,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:35,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:35,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:35,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:35,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:35,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:35,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:35,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:35,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:35,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:35,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:35,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:35,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:35,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:35,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:35,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:35,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:35,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:35,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:35,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:35,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:35,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:35,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:35,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:35,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:35,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:35,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:35,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:35,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:35,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:35,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:35,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:35,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:35,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:35,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:35,248 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:35,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:35,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:35,249 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:35,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:35,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:35,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:35,250 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:35,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:35,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:35,251 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,266 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,295 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:35,297 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,298 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL
2015-02-10 19:08:35,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,313 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:35,313 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:35,318 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:35,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:35,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:35,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-10 19:08:35,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:35,323 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:35,323 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:35,323 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-10 19:08:35,324 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,325 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,347 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:35,348 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,365 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:35,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:35,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:35,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:35,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:35,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:35,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:35,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:35,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:35,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:35,383 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local108385579_0047
2015-02-10 19:08:35,399 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity108385579/.staging/job_local108385579_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,400 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity108385579/.staging/job_local108385579_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:35,443 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108385579_0047/job_local108385579_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,443 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108385579_0047/job_local108385579_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:35,444 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:35,444 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local108385579_0047
2015-02-10 19:08:35,444 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:35,445 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:35,445 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:35,447 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:35,447 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local108385579_0047_m_000000_0
2015-02-10 19:08:35,448 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:35,450 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:35,450 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@59611d68
2015-02-10 19:08:35,451 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:35,451 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:35,477 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:35,478 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:35,478 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:35,478 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:35,478 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:35,481 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:35,481 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:35,485 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:35,485 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:35,488 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,488 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:35,488 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:35,489 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:35,489 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:35,491 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:35,493 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local108385579_0047_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:35,495 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:35,495 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local108385579_0047_m_000000_0' done.
2015-02-10 19:08:35,495 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local108385579_0047_m_000000_0
2015-02-10 19:08:35,496 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:35,499 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:35,500 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:35,500 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:35,501 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,501 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:35,501 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:35,504 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:35,504 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-10 19:08:35,512 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:35,514 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local108385579_0047
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:35,521 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local108385579_0047 state at FAILED
2015-02-10 19:08:35,521 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:35,522 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:35,522 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:35,525 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:35,525 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-10 19:08:35,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:35,526 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE/_temporary
2015-02-10 19:08:35,526 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE
2015-02-10 19:08:35,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:35,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:35,541 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:35,542 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:35,546 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:35,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:35,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:35,551 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:35,551 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:35,551 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-10 19:08:35,551 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:35,551 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:35,552 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:35,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_UNKNOWN_SWAP
2015-02-10 19:08:35,553 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,553 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,575 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:35,576 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,593 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:35,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:35,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:35,603 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:35,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:35,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:35,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:35,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:35,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:35,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:35,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:35,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:35,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:35,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:35,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:35,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:35,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:35,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:35,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:35,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:35,610 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:35,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:35,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:35,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:35,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:35,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:35,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:35,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:35,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:35,613 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:35,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:35,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:35,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,614 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:35,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:35,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:35,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:35,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:35,615 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:35,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:35,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:35,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:35,616 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:35,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:35,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:35,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:35,617 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:35,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:35,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:35,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:35,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:35,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:35,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:35,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:35,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:35,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:35,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:35,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:35,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:35,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:35,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:35,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:35,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:35,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:35,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:35,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:35,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:35,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:35,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:35,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:35,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:35,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:35,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:35,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:35,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:35,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:35,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:35,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:35,624 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:35,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:35,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:35,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:35,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:35,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:35,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:35,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:35,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:35,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:35,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:35,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:35,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:35,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:35,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:35,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:35,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:35,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:35,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:35,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:35,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:35,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:35,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:35,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:35,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:35,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:35,636 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1527674052_0048
2015-02-10 19:08:35,652 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1527674052/.staging/job_local1527674052_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,653 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1527674052/.staging/job_local1527674052_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:35,695 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1527674052_0048/job_local1527674052_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,695 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1527674052_0048/job_local1527674052_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:35,696 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:35,696 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1527674052_0048
2015-02-10 19:08:35,696 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:35,697 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:35,697 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:35,700 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:35,700 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1527674052_0048_m_000000_0
2015-02-10 19:08:35,701 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:35,702 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:35,702 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@464ea113
2015-02-10 19:08:35,703 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:35,704 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:35,721 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:35,721 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:35,721 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:35,721 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:35,721 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:35,723 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:35,723 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:35,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:35,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:35,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,730 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:35,730 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:35,730 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:35,730 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:35,735 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:35,736 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1527674052_0048_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:35,738 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:35,739 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1527674052_0048_m_000000_0' done.
2015-02-10 19:08:35,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1527674052_0048_m_000000_0
2015-02-10 19:08:35,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:35,742 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:35,743 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:35,743 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:35,744 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,744 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:35,744 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:35,747 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:35,747 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-10 19:08:35,768 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1527674052_0048_r_000000_0 is done. And is in the process of committing
2015-02-10 19:08:35,769 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:35,769 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1527674052_0048_r_000000_0 is allowed to commit now
2015-02-10 19:08:35,770 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1527674052_0048_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary/0/task_local1527674052_0048_r_000000
2015-02-10 19:08:35,771 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:35,771 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1527674052_0048_r_000000_0' done.
2015-02-10 19:08:35,786 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary
2015-02-10 19:08:35,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:35,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:35,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:35,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:35,799 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:35,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:35,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:35,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:35,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:35,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:35,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:35,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:35,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:35,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:35,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:35,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:35,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:35,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:35,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:35,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:35,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:35,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:35,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:35,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:35,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:35,803 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:35,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:35,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:35,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:35,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:35,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:35,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:35,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:35,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:35,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:35,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:35,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:35,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:35,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:35,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:35,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:35,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:35,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:35,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:35,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:35,807 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:35,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:35,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:35,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:35,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:35,808 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:35,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:35,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:35,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:35,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:35,809 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:35,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:35,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:35,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:35,810 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:35,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:35,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:35,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:35,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:35,811 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:35,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:35,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:35,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:35,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:35,812 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:35,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:35,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:35,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:35,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:35,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:35,813 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:35,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:35,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:35,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:35,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:35,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:35,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:35,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:35,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:35,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:35,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:35,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:35,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:35,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:35,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:35,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:35,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:35,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:35,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:35,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:35,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:35,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:35,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:35,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:35,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:35,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:35,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:35,819 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:35,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:35,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:35,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:35,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:35,820 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:35,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:35,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:35,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:35,821 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:35,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:35,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:35,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:35,822 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:35,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:35,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:35,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:35,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:35,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:35,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:35,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,840 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,869 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,870 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP
2015-02-10 19:08:35,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:35,886 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:35,887 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:35,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:35,896 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:35,896 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:35,896 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-10 19:08:35,897 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:35,897 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:35,897 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:35,898 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-10 19:08:35,898 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,899 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:35,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:35,922 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:35,940 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:35,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:35,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:35,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:35,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:35,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:35,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:35,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:35,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:35,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:35,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:35,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:35,957 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1932964507_0049
2015-02-10 19:08:35,972 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1932964507/.staging/job_local1932964507_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:35,973 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1932964507/.staging/job_local1932964507_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,000 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:36,015 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1932964507_0049/job_local1932964507_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,015 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1932964507_0049/job_local1932964507_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,016 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:36,017 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1932964507_0049
2015-02-10 19:08:36,017 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:36,017 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:36,017 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:36,019 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:36,019 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1932964507_0049_m_000000_0
2015-02-10 19:08:36,021 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,022 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:36,022 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@608532d1
2015-02-10 19:08:36,023 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:36,023 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:36,040 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:36,040 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:36,040 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:36,041 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:36,041 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:36,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:36,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,045 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,045 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,048 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,048 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:36,048 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:36,049 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:36,049 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:36,051 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:36,053 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1932964507_0049_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:36,054 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:36,054 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1932964507_0049_m_000000_0' done.
2015-02-10 19:08:36,054 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1932964507_0049_m_000000_0
2015-02-10 19:08:36,055 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:36,058 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,059 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:36,059 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:36,060 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,060 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:36,060 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-10 19:08:36,072 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,074 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1932964507_0049
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,078 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1932964507_0049 state at FAILED
2015-02-10 19:08:36,078 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:36,078 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:36,078 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:36,082 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:36,082 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-10 19:08:36,083 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:36,083 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1/_temporary
2015-02-10 19:08:36,084 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1
2015-02-10 19:08:36,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:36,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:36,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:36,099 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:36,099 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:36,103 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_'field'
2015-02-10 19:08:36,116 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:36,117 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:36,117 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:36,122 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:36,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:36,124 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:36,127 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:36,127 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,127 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-10 19:08:36,127 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:36,127 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:36,127 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:36,128 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-10 19:08:36,128 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,129 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,154 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:36,155 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:36,174 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:36,184 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:36,184 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:36,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:36,186 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:36,187 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:36,188 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:36,189 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:36,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:36,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:36,192 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:36,193 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:36,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:36,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:36,196 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:36,197 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:36,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:36,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:36,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:36,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:36,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:36,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:36,199 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:36,200 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:36,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:36,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:36,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:36,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:36,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:36,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:36,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:36,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:36,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:36,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:36,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:36,208 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local971517244_0050
2015-02-10 19:08:36,224 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity971517244/.staging/job_local971517244_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,225 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity971517244/.staging/job_local971517244_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,268 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local971517244_0050/job_local971517244_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,268 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local971517244_0050/job_local971517244_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,269 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:36,269 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local971517244_0050
2015-02-10 19:08:36,269 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:36,269 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:36,269 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:36,272 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:36,273 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local971517244_0050_m_000000_0
2015-02-10 19:08:36,274 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,275 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:36,275 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7a63b09c
2015-02-10 19:08:36,276 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:36,276 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:36,304 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:36,307 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:36,306 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:36,307 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:36,307 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:36,307 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:36,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:36,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,314 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,317 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,317 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:36,317 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:36,317 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:36,317 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:36,320 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:36,322 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local971517244_0050_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:36,323 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:36,324 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local971517244_0050_m_000000_0' done.
2015-02-10 19:08:36,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local971517244_0050_m_000000_0
2015-02-10 19:08:36,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:36,327 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,328 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:36,328 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:36,329 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,329 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:36,329 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,334 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,334 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-10 19:08:36,343 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,345 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local971517244_0050
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,356 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local971517244_0050 state at FAILED
2015-02-10 19:08:36,356 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:36,356 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:36,356 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:36,359 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:36,360 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-10 19:08:36,360 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:36,361 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS/_temporary
2015-02-10 19:08:36,361 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS
2015-02-10 19:08:36,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:36,374 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:36,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:36,376 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:36,376 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:36,380 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:36,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:36,382 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:36,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:36,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-10 19:08:36,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:36,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:36,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:36,386 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-10 19:08:36,387 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,389 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,413 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:36,413 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:36,431 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:36,442 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:36,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:36,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:36,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:36,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:36,443 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:36,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:36,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:36,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:36,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:36,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:36,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:36,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:36,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:36,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:36,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:36,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:36,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:36,447 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:36,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:36,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:36,448 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:36,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:36,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:36,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:36,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:36,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:36,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:36,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:36,451 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:36,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:36,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:36,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:36,452 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:36,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:36,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:36,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:36,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:36,453 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:36,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:36,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:36,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:36,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:36,454 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:36,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:36,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:36,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:36,455 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:36,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:36,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:36,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:36,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:36,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:36,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:36,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:36,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:36,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:36,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:36,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:36,458 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:36,458 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:36,458 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:36,458 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:36,458 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:36,459 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:36,460 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:36,461 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:36,462 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:36,463 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:36,463 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:36,463 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:36,463 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:36,463 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:36,464 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:36,465 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:36,465 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:36,465 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:36,465 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:36,465 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:36,471 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1421124123_0051
2015-02-10 19:08:36,487 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1421124123/.staging/job_local1421124123_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,488 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1421124123/.staging/job_local1421124123_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,534 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1421124123_0051/job_local1421124123_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,534 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1421124123_0051/job_local1421124123_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,535 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:36,535 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1421124123_0051
2015-02-10 19:08:36,535 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:36,535 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:36,537 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:36,540 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:36,540 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1421124123_0051_m_000000_0
2015-02-10 19:08:36,542 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,544 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:36,544 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:36,545 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@298bbe2b
2015-02-10 19:08:36,547 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:36,547 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:36,566 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:36,566 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:36,566 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:36,566 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:36,567 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:36,569 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:36,569 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,573 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,573 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,576 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,578 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:36,578 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:36,579 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:36,579 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:36,582 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:36,584 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1421124123_0051_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:36,585 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:36,586 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1421124123_0051_m_000000_0' done.
2015-02-10 19:08:36,586 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1421124123_0051_m_000000_0
2015-02-10 19:08:36,586 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:36,589 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,590 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:36,590 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:36,591 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,591 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:36,591 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,604 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,604 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-10 19:08:36,613 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,615 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1421124123_0051
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,621 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1421124123_0051 state at FAILED
2015-02-10 19:08:36,622 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:36,622 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:36,622 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:36,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:36,627 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-10 19:08:36,627 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:36,628 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL/_temporary
2015-02-10 19:08:36,628 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL
2015-02-10 19:08:36,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:36,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:36,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:36,643 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:36,644 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:36,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:36,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:36,650 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:36,653 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:36,653 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,653 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-10 19:08:36,654 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:36,654 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:36,655 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:36,656 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-10 19:08:36,656 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,657 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,688 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:36,689 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:36,714 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:36,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:36,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:36,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:36,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:36,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:36,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:36,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:36,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:36,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:36,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:36,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:36,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:36,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:36,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:36,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:36,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:36,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:36,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:36,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:36,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:36,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:36,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:36,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:36,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:36,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:36,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:36,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:36,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:36,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:36,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:36,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:36,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:36,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:36,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:36,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:36,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:36,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:36,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:36,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:36,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:36,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:36,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:36,738 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:36,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:36,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:36,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:36,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:36,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:36,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:36,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:36,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:36,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:36,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:36,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:36,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:36,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:36,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:36,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:36,743 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:36,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:36,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:36,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:36,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:36,744 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:36,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:36,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:36,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:36,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:36,745 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:36,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:36,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:36,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:36,746 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:36,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:36,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:36,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:36,747 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:36,753 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local458562227_0052
2015-02-10 19:08:36,772 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity458562227/.staging/job_local458562227_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,774 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity458562227/.staging/job_local458562227_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,817 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local458562227_0052/job_local458562227_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:36,818 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local458562227_0052/job_local458562227_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:36,819 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:36,819 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local458562227_0052
2015-02-10 19:08:36,819 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:36,819 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:36,819 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:36,821 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:36,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local458562227_0052_m_000000_0
2015-02-10 19:08:36,823 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,825 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:36,825 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7140d7c6
2015-02-10 19:08:36,827 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:36,827 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:36,828 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:36,845 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:36,845 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:36,845 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:36,846 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:36,846 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:36,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:36,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,851 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,851 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,854 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,854 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:36,854 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:36,855 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:36,855 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:36,857 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:36,859 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local458562227_0052_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:36,860 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:36,861 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local458562227_0052_m_000000_0' done.
2015-02-10 19:08:36,861 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local458562227_0052_m_000000_0
2015-02-10 19:08:36,861 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:36,864 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:36,865 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:36,865 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:36,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:36,866 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:36,866 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:36,869 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:36,869 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-10 19:08:36,877 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,880 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local458562227_0052
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:36,881 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local458562227_0052 state at FAILED
2015-02-10 19:08:36,881 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:36,881 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:36,881 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:36,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:36,885 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-10 19:08:36,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:36,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 19:08:36,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 19:08:36,886 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE/_temporary
2015-02-10 19:08:36,886 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE
2015-02-10 19:08:36,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:36,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:36,900 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:36,901 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:36,902 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:36,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:36,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:36,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:36,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:36,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:36,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-10 19:08:36,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:36,912 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:36,912 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:36,913 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-10 19:08:36,913 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,914 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:36,938 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:36,939 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:36,958 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:36,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:36,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:36,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:36,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:36,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:36,972 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:36,973 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:36,974 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:36,974 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:36,974 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:36,974 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:36,974 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:36,974 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:36,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:36,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:36,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:36,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:36,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:36,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:36,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:36,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:36,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:36,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:36,977 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:36,977 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:36,977 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:36,977 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:36,977 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:36,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:36,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:36,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:36,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:36,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:36,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:36,979 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:36,980 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:36,981 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:36,982 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:36,983 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:36,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:36,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:36,986 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:36,987 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:36,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:36,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:36,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:36,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:36,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:36,988 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:36,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:36,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:36,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:36,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:36,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:36,990 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:36,997 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local665828650_0053
2015-02-10 19:08:37,013 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity665828650/.staging/job_local665828650_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,014 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity665828650/.staging/job_local665828650_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,056 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local665828650_0053/job_local665828650_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,056 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local665828650_0053/job_local665828650_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,057 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:37,058 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local665828650_0053
2015-02-10 19:08:37,058 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:37,058 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:37,058 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:37,060 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:37,061 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local665828650_0053_m_000000_0
2015-02-10 19:08:37,062 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,064 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:37,064 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@79f7e9d3
2015-02-10 19:08:37,065 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:37,065 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:37,091 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:37,092 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:37,092 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:37,093 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2015-02-10 19:08:37,093 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:37,093 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:37,095 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:37,095 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,099 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,099 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,102 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,102 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:37,102 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:37,102 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:37,102 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:37,105 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:37,106 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local665828650_0053_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:37,107 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:37,108 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local665828650_0053_m_000000_0' done.
2015-02-10 19:08:37,108 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local665828650_0053_m_000000_0
2015-02-10 19:08:37,108 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:37,112 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,112 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:37,113 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:37,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:37,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,117 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,117 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-10 19:08:37,125 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,127 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local665828650_0053
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,132 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local665828650_0053 state at FAILED
2015-02-10 19:08:37,132 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:37,132 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:37,133 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:37,135 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:37,136 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-10 19:08:37,136 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:37,137 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP/_temporary
2015-02-10 19:08:37,137 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP
2015-02-10 19:08:37,150 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:37,150 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:37,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:37,152 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:37,152 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:37,156 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:37,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:37,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-10 19:08:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:37,162 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:37,162 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:37,162 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-10 19:08:37,163 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:37,165 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:37,190 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:37,191 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:37,210 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:37,221 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:37,222 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:37,223 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:37,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:37,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:37,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:37,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:37,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:37,225 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:37,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:37,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:37,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:37,226 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:37,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:37,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:37,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:37,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:37,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:37,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:37,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:37,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:37,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:37,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:37,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:37,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:37,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:37,229 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:37,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:37,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:37,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:37,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:37,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:37,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:37,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:37,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:37,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:37,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:37,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:37,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:37,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:37,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:37,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:37,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:37,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:37,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:37,233 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:37,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:37,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:37,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:37,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:37,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:37,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:37,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:37,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:37,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:37,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:37,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:37,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:37,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:37,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:37,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:37,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:37,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:37,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:37,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:37,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:37,238 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:37,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:37,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:37,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:37,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:37,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:37,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:37,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:37,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:37,240 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:37,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:37,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:37,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:37,241 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:37,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:37,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:37,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:37,242 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:37,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:37,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:37,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:37,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:37,243 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:37,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:37,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:37,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:37,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:37,244 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:37,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:37,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:37,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:37,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:37,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:37,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:37,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:37,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:37,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:37,252 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local280518685_0054
2015-02-10 19:08:37,268 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity280518685/.staging/job_local280518685_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,269 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity280518685/.staging/job_local280518685_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,317 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local280518685_0054/job_local280518685_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,317 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local280518685_0054/job_local280518685_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,318 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:37,318 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local280518685_0054
2015-02-10 19:08:37,319 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:37,319 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:37,319 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:37,322 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:37,322 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local280518685_0054_m_000000_0
2015-02-10 19:08:37,323 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,325 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:37,325 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1ca68033
2015-02-10 19:08:37,326 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:37,326 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:37,344 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:37,344 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:37,344 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:37,344 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:37,344 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:37,346 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:37,346 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,351 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,351 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,354 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,354 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:37,354 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:37,354 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:37,354 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:37,357 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:37,359 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local280518685_0054_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:37,360 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:37,361 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local280518685_0054_m_000000_0' done.
2015-02-10 19:08:37,361 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local280518685_0054_m_000000_0
2015-02-10 19:08:37,361 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:37,366 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,367 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:37,367 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:37,368 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,368 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:37,368 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,372 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,372 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-10 19:08:37,380 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,383 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local280518685_0054
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,390 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local280518685_0054 state at FAILED
2015-02-10 19:08:37,391 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:37,391 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:37,391 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:37,404 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:37,404 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-10 19:08:37,405 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:37,405 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1/_temporary
2015-02-10 19:08:37,405 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1
2015-02-10 19:08:37,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:37,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:37,420 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:37,421 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:37,421 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:37,425 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_'field'
2015-02-10 19:08:37,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:37,439 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:37,440 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:37,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:37,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:37,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:37,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:37,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-10 19:08:37,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:37,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:37,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:37,450 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-10 19:08:37,450 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:37,451 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:37,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:37,477 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:37,497 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:37,508 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:37,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:37,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:37,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:37,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:37,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:37,510 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:37,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:37,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:37,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:37,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:37,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:37,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:37,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:37,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:37,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:37,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:37,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:37,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:37,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:37,515 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:37,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:37,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:37,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:37,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:37,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:37,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:37,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:37,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:37,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:37,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:37,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:37,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:37,518 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:37,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:37,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:37,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:37,519 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:37,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:37,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:37,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:37,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:37,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:37,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:37,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:37,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:37,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:37,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:37,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:37,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:37,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:37,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:37,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:37,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:37,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:37,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:37,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:37,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:37,524 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:37,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:37,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:37,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:37,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:37,525 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:37,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:37,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:37,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:37,526 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:37,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:37,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:37,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:37,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:37,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:37,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:37,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:37,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:37,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:37,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:37,529 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:37,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:37,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:37,530 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:37,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:37,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:37,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:37,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:37,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:37,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:37,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:37,532 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:37,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:37,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:37,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:37,533 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:37,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:37,534 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:37,540 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local385762477_0055
2015-02-10 19:08:37,556 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity385762477/.staging/job_local385762477_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,558 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity385762477/.staging/job_local385762477_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,606 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local385762477_0055/job_local385762477_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,606 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local385762477_0055/job_local385762477_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,608 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:37,608 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local385762477_0055
2015-02-10 19:08:37,608 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:37,608 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:37,609 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:37,611 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:37,611 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local385762477_0055_m_000000_0
2015-02-10 19:08:37,613 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,614 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:37,614 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@41350279
2015-02-10 19:08:37,615 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:37,615 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:37,633 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:37,633 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:37,633 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:37,633 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:37,633 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:37,634 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:37,634 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,638 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,638 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,641 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,641 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:37,641 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:37,641 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:37,641 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:37,644 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:37,645 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local385762477_0055_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:37,647 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:37,647 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local385762477_0055_m_000000_0' done.
2015-02-10 19:08:37,647 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local385762477_0055_m_000000_0
2015-02-10 19:08:37,647 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:37,703 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,704 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:37,704 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:37,704 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,705 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:37,705 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,708 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,708 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-10 19:08:37,718 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,720 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local385762477_0055
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,720 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local385762477_0055 state at FAILED
2015-02-10 19:08:37,720 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:37,720 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:37,721 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:37,724 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:37,725 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-10 19:08:37,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:37,726 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS/_temporary
2015-02-10 19:08:37,726 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS
2015-02-10 19:08:37,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:37,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:37,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:37,742 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:37,743 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:37,746 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_ALL
2015-02-10 19:08:37,762 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:37,763 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:37,764 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:37,768 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:37,770 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:37,771 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:37,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:37,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-10 19:08:37,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:37,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:37,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:37,775 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-10 19:08:37,777 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:37,778 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:37,802 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:37,803 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:37,821 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:37,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:37,830 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:37,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:37,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:37,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:37,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:37,831 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:37,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:37,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:37,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:37,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:37,832 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:37,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:37,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:37,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:37,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:37,833 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:37,834 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:37,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:37,836 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:37,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:37,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:37,839 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:37,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:37,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:37,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:37,843 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:37,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:37,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:37,846 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:37,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:37,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:37,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:37,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:37,848 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:37,854 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1837391020_0056
2015-02-10 19:08:37,871 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1837391020/.staging/job_local1837391020_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,872 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity1837391020/.staging/job_local1837391020_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,916 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1837391020_0056/job_local1837391020_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:37,916 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1837391020_0056/job_local1837391020_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:37,917 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:37,917 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1837391020_0056
2015-02-10 19:08:37,917 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:37,918 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:37,918 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:37,921 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:37,922 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1837391020_0056_m_000000_0
2015-02-10 19:08:37,923 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,924 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:37,924 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@21aa4aaf
2015-02-10 19:08:37,925 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:37,926 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:37,952 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:37,952 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:37,952 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:37,952 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:37,953 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:37,954 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:37,954 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:37,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,960 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,961 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:37,961 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:37,961 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:37,961 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:37,963 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:37,965 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1837391020_0056_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:37,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:37,967 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1837391020_0056_m_000000_0' done.
2015-02-10 19:08:37,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1837391020_0056_m_000000_0
2015-02-10 19:08:37,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:37,972 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:37,973 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:37,974 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:37,974 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:37,975 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:37,975 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:37,980 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:37,980 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-10 19:08:37,988 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,990 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1837391020_0056
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:37,995 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1837391020_0056 state at FAILED
2015-02-10 19:08:37,995 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:37,996 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:37,996 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:37,999 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:37,999 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-10 19:08:38,000 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:38,000 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE/_temporary
2015-02-10 19:08:38,001 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE
2015-02-10 19:08:38,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-02-10 19:08:38,015 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-02-10 19:08:38,016 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-02-10 19:08:38,017 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 19:08:38,017 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 19:08:38,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 19:08:38,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 19:08:38,023 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 19:08:38,026 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 19:08:38,026 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:38,026 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-10 19:08:38,026 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 19:08:38,026 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 19:08:38,027 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 19:08:38,027 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-10 19:08:38,028 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:38,028 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 19:08:38,052 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-02-10 19:08:38,053 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 19:08:38,071 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-02-10 19:08:38,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-02-10 19:08:38,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-02-10 19:08:38,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-02-10 19:08:38,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-02-10 19:08:38,081 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-02-10 19:08:38,082 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-02-10 19:08:38,083 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-02-10 19:08:38,084 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-02-10 19:08:38,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-02-10 19:08:38,086 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-02-10 19:08:38,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-02-10 19:08:38,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-02-10 19:08:38,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-02-10 19:08:38,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-02-10 19:08:38,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-02-10 19:08:38,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-02-10 19:08:38,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-02-10 19:08:38,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-02-10 19:08:38,088 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-02-10 19:08:38,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-02-10 19:08:38,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-02-10 19:08:38,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-02-10 19:08:38,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-02-10 19:08:38,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-02-10 19:08:38,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-02-10 19:08:38,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-02-10 19:08:38,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-02-10 19:08:38,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-02-10 19:08:38,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-02-10 19:08:38,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-02-10 19:08:38,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-02-10 19:08:38,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-02-10 19:08:38,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-02-10 19:08:38,091 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-02-10 19:08:38,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-02-10 19:08:38,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-02-10 19:08:38,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-02-10 19:08:38,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-02-10 19:08:38,092 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-02-10 19:08:38,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-02-10 19:08:38,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-02-10 19:08:38,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-02-10 19:08:38,093 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-02-10 19:08:38,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-02-10 19:08:38,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-02-10 19:08:38,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-02-10 19:08:38,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-02-10 19:08:38,094 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-02-10 19:08:38,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-02-10 19:08:38,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-02-10 19:08:38,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-02-10 19:08:38,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-02-10 19:08:38,095 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-02-10 19:08:38,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-02-10 19:08:38,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-02-10 19:08:38,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-02-10 19:08:38,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-02-10 19:08:38,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-02-10 19:08:38,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-02-10 19:08:38,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-02-10 19:08:38,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-02-10 19:08:38,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-02-10 19:08:38,097 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-02-10 19:08:38,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-02-10 19:08:38,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-02-10 19:08:38,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-02-10 19:08:38,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-02-10 19:08:38,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-02-10 19:08:38,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-02-10 19:08:38,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-02-10 19:08:38,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-02-10 19:08:38,101 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-02-10 19:08:38,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-02-10 19:08:38,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-02-10 19:08:38,102 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-02-10 19:08:38,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-02-10 19:08:38,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-02-10 19:08:38,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-02-10 19:08:38,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-02-10 19:08:38,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-02-10 19:08:38,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-02-10 19:08:38,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-02-10 19:08:38,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-02-10 19:08:38,104 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-02-10 19:08:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-02-10 19:08:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-02-10 19:08:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-02-10 19:08:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-02-10 19:08:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-02-10 19:08:38,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-02-10 19:08:38,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-02-10 19:08:38,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-02-10 19:08:38,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-02-10 19:08:38,106 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-02-10 19:08:38,113 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local928155235_0057
2015-02-10 19:08:38,129 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity928155235/.staging/job_local928155235_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:38,130 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/tmp/cascading/staging/teamcity928155235/.staging/job_local928155235_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:38,171 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local928155235_0057/job_local928155235_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 19:08:38,172 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local928155235_0057/job_local928155235_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 19:08:38,173 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2015-02-10 19:08:38,173 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local928155235_0057
2015-02-10 19:08:38,173 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 19:08:38,173 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2015-02-10 19:08:38,174 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 19:08:38,176 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2015-02-10 19:08:38,177 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local928155235_0057_m_000000_0
2015-02-10 19:08:38,178 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:38,179 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt
2015-02-10 19:08:38,179 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@673f2af1
2015-02-10 19:08:38,180 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2015-02-10 19:08:38,181 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 19:08:38,201 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 19:08:38,201 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 19:08:38,201 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 19:08:38,201 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 19:08:38,201 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 19:08:38,203 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 19:08:38,203 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 19:08:38,207 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt"]
2015-02-10 19:08:38,207 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:38,210 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:38,210 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2015-02-10 19:08:38,210 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2015-02-10 19:08:38,210 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 19:08:38,210 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 19:08:38,213 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2015-02-10 19:08:38,215 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local928155235_0057_m_000000_0 is done. And is in the process of committing
2015-02-10 19:08:38,217 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 19:08:38,217 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local928155235_0057_m_000000_0' done.
2015-02-10 19:08:38,217 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local928155235_0057_m_000000_0
2015-02-10 19:08:38,217 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2015-02-10 19:08:38,221 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 19:08:38,221 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2015-02-10 19:08:38,222 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 19:08:38,222 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2015-02-10 19:08:38,222 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 19:08:38,222 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 19:08:38,225 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 19:08:38,225 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-10 19:08:38,241 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:38,245 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local928155235_0057
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
2015-02-10 19:08:38,246 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local928155235_0057 state at FAILED
2015-02-10 19:08:38,246 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 19:08:38,246 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 19:08:38,247 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 19:08:38,251 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 19:08:38,251 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-10 19:08:38,252 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 19:08:38,252 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP/_temporary
2015-02-10 19:08:38,253 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.2.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP