2013-10-31 20:27:05,985 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2013-10-31 20:27:06,002 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2013-10-31 20:27:06,002 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.tuple.hadoop.SerializedPipesPlatformTest
2013-10-31 20:27:06,023 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(118)) - using cluster
2013-10-31 20:27:06,247 INFO util.GSet (BlocksMap.java:computeCapacity(338)) - VM type = 64-bit
2013-10-31 20:27:06,248 INFO util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 20:27:06,248 INFO util.GSet (BlocksMap.java:computeCapacity(340)) - capacity = 2^21 = 2097152 entries
2013-10-31 20:27:06,248 INFO util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 20:27:06,421 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 20:27:06,422 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 20:27:06,422 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 20:27:06,424 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 20:27:06,425 WARN namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 20:27:06,425 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 20:27:06,430 INFO namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times
2013-10-31 20:27:06,570 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 20:27:06,892 INFO common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name1 has been successfully formatted.
2013-10-31 20:27:06,894 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 20:27:06,986 INFO common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name2 has been successfully formatted.
2013-10-31 20:27:07,025 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-namenode.properties, hadoop-metrics2.properties
2013-10-31 20:27:07,093 INFO util.GSet (BlocksMap.java:computeCapacity(338)) - VM type = 64-bit
2013-10-31 20:27:07,093 INFO util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 20:27:07,093 INFO util.GSet (BlocksMap.java:computeCapacity(340)) - capacity = 2^21 = 2097152 entries
2013-10-31 20:27:07,093 INFO util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 20:27:07,097 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 20:27:07,097 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 20:27:07,097 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 20:27:07,098 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 20:27:07,098 WARN namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 20:27:07,098 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 20:27:07,101 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(5306)) - Registered FSNamesystemStateMBean and NameNodeMXBean
2013-10-31 20:27:07,101 INFO namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times
2013-10-31 20:27:07,105 INFO common.Storage (FSImage.java:loadFSImage(899)) - Number of files = 1
2013-10-31 20:27:07,106 INFO common.Storage (FSImage.java:loadFilesUnderConstruction(1435)) - Number of files under construction = 0
2013-10-31 20:27:07,106 INFO common.Storage (FSImage.java:loadFSImage(832)) - Image file of size 112 loaded in 0 seconds.
2013-10-31 20:27:07,106 INFO common.Storage (FSEditLog.java:loadFSEdits(901)) - Edits file build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0 seconds.
2013-10-31 20:27:07,107 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 20:27:07,228 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 20:27:07,335 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2013-10-31 20:27:07,336 INFO namenode.FSNamesystem (FSNamesystem.java:initialize(397)) - Finished loading FSImage in 239 msecs
2013-10-31 20:27:07,356 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3816)) - Total number of blocks = 0
2013-10-31 20:27:07,357 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3817)) - Number of invalid blocks = 0
2013-10-31 20:27:07,357 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3818)) - Number of under-replicated blocks = 0
2013-10-31 20:27:07,358 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3819)) - Number of over-replicated blocks = 0
2013-10-31 20:27:07,358 INFO hdfs.StateChange (FSNamesystem.java:leave(4783)) - STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 19 msec
2013-10-31 20:27:07,359 INFO hdfs.StateChange (FSNamesystem.java:leave(4789)) - STATE* Leaving safe mode after 0 secs.
2013-10-31 20:27:07,360 INFO hdfs.StateChange (FSNamesystem.java:leave(4798)) - STATE* Network topology has 0 racks and 0 datanodes
2013-10-31 20:27:07,360 INFO hdfs.StateChange (FSNamesystem.java:leave(4801)) - STATE* UnderReplicatedBlocks has 0 blocks
2013-10-31 20:27:07,370 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 20:27:07,371 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 2 msec
2013-10-31 20:27:07,372 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 2 msec processing time, 2 msec clock time, 1 cycles
2013-10-31 20:27:07,372 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 20:27:07,372 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 20:27:07,380 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:07,383 INFO namenode.NameNode (NameNode.java:initialize(301)) - Namenode up at: /127.0.0.1:52817
2013-10-31 20:27:07,420 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-10-31 20:27:07,471 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:07,480 INFO http.HttpServer (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 20:27:07,485 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:07,486 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 34202 webServer.getConnectors()[0].getLocalPort() returned 34202
2013-10-31 20:27:07,487 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 34202
2013-10-31 20:27:07,487 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:07,523 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/hdfs to /tmp/Jetty_localhost_34202_hdfs____9r81ul/webapp
2013-10-31 20:27:07,858 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:34202
2013-10-31 20:27:07,858 INFO namenode.NameNode (NameNode.java:run(451)) - Web-server up at: localhost:34202
2013-10-31 20:27:07,859 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:07,897 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 52817: starting
2013-10-31 20:27:07,898 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 52817: starting
2013-10-31 20:27:07,898 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 52817: starting
2013-10-31 20:27:07,898 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 52817: starting
2013-10-31 20:27:07,898 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 52817: starting
2013-10-31 20:27:07,899 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 52817: starting
2013-10-31 20:27:07,898 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 52817: starting
2013-10-31 20:27:07,899 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 52817: starting
2013-10-31 20:27:07,900 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 52817: starting
2013-10-31 20:27:07,899 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 52817: starting
2013-10-31 20:27:07,899 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 52817: starting
2013-10-31 20:27:08,038 INFO metrics.MetricsSaver (?:<init>(?)) - MetricsSaver GradleWorkerMain root:hdfs:///mnt/var/lib/hadoop/metrics/ period:60 instanceId:i-3e21d259 jobflow:j-3AAKWCJW7N40B
Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
2013-10-31 20:27:08,091 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 20:27:08,092 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:08,132 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data1 is not formatted.
2013-10-31 20:27:08,132 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:08,287 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data2 is not formatted.
2013-10-31 20:27:08,288 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:08,413 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 20:27:08,427 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 37249
2013-10-31 20:27:08,428 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 20:27:08,431 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:08,433 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 20:27:08,433 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:08,434 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 41185 webServer.getConnectors()[0].getLocalPort() returned 41185
2013-10-31 20:27:08,434 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 41185
2013-10-31 20:27:08,434 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:08,440 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_41185_datanode____9icbso/webapp
2013-10-31 20:27:08,640 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:41185
2013-10-31 20:27:08,643 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:08,643 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:37249, storageID=, infoPort=41185, ipcPort=43642)
2013-10-31 20:27:08,659 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:37249 storage DS-962712564-10.5.128.102-37249-1383251228659
2013-10-31 20:27:08,662 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:37249
2013-10-31 20:27:08,723 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-962712564-10.5.128.102-37249-1383251228659 is assigned to data-node 127.0.0.1:37249
2013-10-31 20:27:08,724 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 20:27:08,726 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:37249 0 blocks
2013-10-31 20:27:08,726 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 20:27:08,727 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data1/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data2/current'}
Starting DataNode 1 with dfs.data.dir: build/test/data/dfs/data/data3,build/test/data/dfs/data/data4
2013-10-31 20:27:08,727 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 0ms
2013-10-31 20:27:08,728 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:08,728 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 43642: starting
2013-10-31 20:27:08,729 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 43642: starting
2013-10-31 20:27:08,728 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 20:27:08,729 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 43642: starting
2013-10-31 20:27:08,729 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 20:27:08,729 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 43642: starting
2013-10-31 20:27:08,730 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:08,731 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:08,735 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:37249, blocks: 0, processing time: 2 msecs
2013-10-31 20:27:08,736 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 1 msec to generate and 4 msecs for RPC and NN processing
2013-10-31 20:27:08,736 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 20:27:08,737 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 20:27:08,737 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:08,743 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data3 is not formatted.
2013-10-31 20:27:08,744 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:08,829 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data4 is not formatted.
2013-10-31 20:27:08,829 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:08,931 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 20:27:08,932 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:08,936 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 33202
2013-10-31 20:27:08,937 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 20:27:08,940 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:08,942 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 20:27:08,942 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:08,943 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 36813 webServer.getConnectors()[0].getLocalPort() returned 36813
2013-10-31 20:27:08,943 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 36813
2013-10-31 20:27:08,944 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:08,951 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_36813_datanode____.pf9nya/webapp
2013-10-31 20:27:09,141 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:36813
2013-10-31 20:27:09,143 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:09,143 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:33202, storageID=, infoPort=36813, ipcPort=42909)
2013-10-31 20:27:09,144 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:33202 storage DS-847897947-10.5.128.102-33202-1383251229143
2013-10-31 20:27:09,144 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:33202
2013-10-31 20:27:09,172 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-847897947-10.5.128.102-33202-1383251229143 is assigned to data-node 127.0.0.1:33202
2013-10-31 20:27:09,172 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 20:27:09,173 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:33202 0 blocks
Starting DataNode 2 with dfs.data.dir: build/test/data/dfs/data/data5,build/test/data/dfs/data/data6
2013-10-31 20:27:09,174 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 20:27:09,174 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data3/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data4/current'}
2013-10-31 20:27:09,175 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 20:27:09,176 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 42909: starting
2013-10-31 20:27:09,176 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 42909: starting
2013-10-31 20:27:09,176 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 20:27:09,176 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 20:27:09,177 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 42909: starting
2013-10-31 20:27:09,176 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:09,177 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:09,177 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 42909: starting
2013-10-31 20:27:09,178 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:09,180 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:33202, blocks: 0, processing time: 0 msecs
2013-10-31 20:27:09,181 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 2 msec to generate and 1 msecs for RPC and NN processing
2013-10-31 20:27:09,181 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 20:27:09,182 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 20:27:09,182 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:09,194 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data5 is not formatted.
2013-10-31 20:27:09,194 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:09,276 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data6 is not formatted.
2013-10-31 20:27:09,277 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:09,348 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 20:27:09,349 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:09,353 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 46399
2013-10-31 20:27:09,354 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 20:27:09,357 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:09,359 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 20:27:09,359 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:09,360 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 38586 webServer.getConnectors()[0].getLocalPort() returned 38586
2013-10-31 20:27:09,360 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 38586
2013-10-31 20:27:09,361 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:09,369 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_38586_datanode____mwg6z9/webapp
2013-10-31 20:27:09,559 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:38586
2013-10-31 20:27:09,561 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:09,561 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:46399, storageID=, infoPort=38586, ipcPort=35272)
2013-10-31 20:27:09,562 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:46399 storage DS-1218196606-10.5.128.102-46399-1383251229561
2013-10-31 20:27:09,562 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:46399
2013-10-31 20:27:09,603 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1218196606-10.5.128.102-46399-1383251229561 is assigned to data-node 127.0.0.1:46399
2013-10-31 20:27:09,604 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 20:27:09,605 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:46399 0 blocks
2013-10-31 20:27:09,605 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 3 with dfs.data.dir: build/test/data/dfs/data/data7,build/test/data/dfs/data/data8
2013-10-31 20:27:09,607 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data5/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data6/current'}
2013-10-31 20:27:09,607 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 20:27:09,612 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:09,612 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 35272: starting
2013-10-31 20:27:09,614 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 20:27:09,613 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 35272: starting
2013-10-31 20:27:09,617 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 35272: starting
2013-10-31 20:27:09,617 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:09,614 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 20:27:09,614 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 35272: starting
2013-10-31 20:27:09,623 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:09,627 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:46399, blocks: 0, processing time: 0 msecs
2013-10-31 20:27:09,628 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 5 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 20:27:09,633 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 20:27:09,633 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 20:27:09,634 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:09,645 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data7 is not formatted.
2013-10-31 20:27:09,646 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:09,708 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data8 is not formatted.
2013-10-31 20:27:09,708 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 20:27:09,773 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 20:27:09,774 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:09,778 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 49827
2013-10-31 20:27:09,778 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 20:27:09,780 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:09,782 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 20:27:09,782 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:09,783 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 36040 webServer.getConnectors()[0].getLocalPort() returned 36040
2013-10-31 20:27:09,783 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 36040
2013-10-31 20:27:09,783 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:09,790 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_36040_datanode____.mbbqcw/webapp
2013-10-31 20:27:09,954 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:36040
2013-10-31 20:27:09,956 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:09,957 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:49827, storageID=, infoPort=36040, ipcPort=38207)
2013-10-31 20:27:09,958 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:49827 storage DS-1604804401-10.5.128.102-49827-1383251229957
2013-10-31 20:27:09,958 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:49827
2013-10-31 20:27:09,990 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1604804401-10.5.128.102-49827-1383251229957 is assigned to data-node 127.0.0.1:49827
2013-10-31 20:27:09,991 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 20:27:09,993 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:49827 0 blocks
2013-10-31 20:27:09,994 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 20:27:09,995 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data7/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data8/current'}
2013-10-31 20:27:09,996 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 20:27:10,000 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:10,001 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 38207: starting
2013-10-31 20:27:10,003 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 38207: starting
2013-10-31 20:27:10,001 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 20:27:10,001 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 38207: starting
2013-10-31 20:27:10,000 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 38207: starting
2013-10-31 20:27:10,008 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:10,016 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 20:27:10,024 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:49827, blocks: 0, processing time: 0 msecs
2013-10-31 20:27:10,025 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 1 msec to generate and 17 msecs for RPC and NN processing
2013-10-31 20:27:10,025 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 20:27:10,027 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 20:27:10,028 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
Generating rack names for tasktrackers
Generating host names for tasktrackers
2013-10-31 20:27:10,082 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties, hadoop-metrics2.properties
2013-10-31 20:27:10,082 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=JobTracker,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:285)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:112)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 20:27:10,113 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 20:27:10,114 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(377)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-10-31 20:27:10,114 INFO mapred.JobTracker (JobTracker.java:initializeTaskMemoryRelatedConfig(5174)) - Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-10-31 20:27:10,114 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 20:27:10,115 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 20:27:10,116 INFO mapred.JobTracker (JobTracker.java:<init>(2279)) - Starting jobtracker with owner as hadoop
2013-10-31 20:27:10,162 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:10,171 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:10,195 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:10,196 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 42962 webServer.getConnectors()[0].getLocalPort() returned 42962
2013-10-31 20:27:10,196 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 42962
2013-10-31 20:27:10,196 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:10,206 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/job to /tmp/Jetty_localhost_42962_job____o11rr/webapp
2013-10-31 20:27:10,366 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:42962
2013-10-31 20:27:10,369 INFO mapred.JobTracker (JobTracker.java:<init>(2347)) - JobTracker up at: 51048
2013-10-31 20:27:10,369 INFO mapred.JobTracker (JobTracker.java:<init>(2351)) - JobTracker webserver: 42962
2013-10-31 20:27:10,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system dst=null perm=null
2013-10-31 20:27:10,378 INFO mapred.JobTracker (JobTracker.java:<init>(2405)) - Creating the system directory
2013-10-31 20:27:10,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:27:10,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:27:10,477 INFO mapred.JobTracker (JobTracker.java:<init>(2469)) - History server being initialized in embedded mode
2013-10-31 20:27:10,481 INFO mapred.JobHistoryServer (JobHistoryServer.java:start(196)) - Started job history server at: localhost:42962
2013-10-31 20:27:10,481 INFO mapred.JobTracker (JobTracker.java:<init>(2472)) - Job History Server web address: localhost:42962
2013-10-31 20:27:10,484 INFO mapred.CompletedJobStatusStore (CompletedJobStatusStore.java:<init>(111)) - Completed job store is inactive
2013-10-31 20:27:10,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:10,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info dst=null perm=hadoop:supergroup:rw-------
2013-10-31 20:27:10,554 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info. blk_6920487667347938972_1001
2013-10-31 20:27:10,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6920487667347938972_1001 src: /127.0.0.1:34577 dest: /127.0.0.1:49827
2013-10-31 20:27:10,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6920487667347938972_1001 src: /127.0.0.1:42964 dest: /127.0.0.1:33202
2013-10-31 20:27:10,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6920487667347938972_1001 src: /127.0.0.1:33183 dest: /127.0.0.1:37249
2013-10-31 20:27:10,603 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33183, dest: /127.0.0.1:37249, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6920487667347938972_1001, duration: 3155655
2013-10-31 20:27:10,603 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6920487667347938972_1001 terminating
2013-10-31 20:27:10,604 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42964, dest: /127.0.0.1:33202, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6920487667347938972_1001, duration: 4452356
2013-10-31 20:27:10,605 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6920487667347938972_1001 terminating
2013-10-31 20:27:10,606 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34577, dest: /127.0.0.1:49827, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6920487667347938972_1001, duration: 4870566
2013-10-31 20:27:10,607 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6920487667347938972_1001 size 4
2013-10-31 20:27:10,607 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6920487667347938972_1001 terminating
2013-10-31 20:27:10,611 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6920487667347938972_1001 size 4
2013-10-31 20:27:10,612 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info from client DFSClient_848976415
2013-10-31 20:27:10,612 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info is closed by DFSClient_848976415
2013-10-31 20:27:10,612 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6920487667347938972_1001 size 4
2013-10-31 20:27:10,617 INFO mapred.JobTracker (JobTracker.java:refreshHosts(4945)) - Refreshing hosts information
2013-10-31 20:27:10,632 INFO util.HostsFileReader (HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to
2013-10-31 20:27:10,632 INFO util.HostsFileReader (HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to
2013-10-31 20:27:10,632 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 20:27:10,632 INFO mapred.JobTracker (JobTracker.java:decommissionNodes(4989)) - Decommissioning 0 nodes
2013-10-31 20:27:10,633 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:10,633 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 51048: starting
2013-10-31 20:27:10,634 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 51048: starting
2013-10-31 20:27:10,635 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 51048: starting
2013-10-31 20:27:10,634 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 51048: starting
2013-10-31 20:27:10,633 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 51048: starting
2013-10-31 20:27:10,633 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 51048: starting
2013-10-31 20:27:10,636 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 51048: starting
2013-10-31 20:27:10,633 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 51048: starting
2013-10-31 20:27:10,636 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 51048: starting
2013-10-31 20:27:10,636 INFO mapred.JobTracker (JobTracker.java:offerService(2630)) - Starting RUNNING
2013-10-31 20:27:10,635 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 51048: starting
2013-10-31 20:27:10,635 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 51048: starting
2013-10-31 20:27:11,041 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0
2013-10-31 20:27:16,069 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:16,086 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 20:27:16,089 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 20:27:16,089 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0
2013-10-31 20:27:16,102 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-10-31 20:27:16,107 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:16,108 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:16,108 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 35954: starting
2013-10-31 20:27:16,108 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 35954: starting
2013-10-31 20:27:16,111 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 35954: starting
2013-10-31 20:27:16,111 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:35954
2013-10-31 20:27:16,110 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 35954: starting
2013-10-31 20:27:16,109 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 35954: starting
2013-10-31 20:27:16,111 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:27:16,124 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:27:16,134 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2013-10-31 20:27:16,143 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@39f86091
2013-10-31 20:27:16,147 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 20:27:16,192 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 20:27:16,200 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:16,200 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 59617 webServer.getConnectors()[0].getLocalPort() returned 59617
2013-10-31 20:27:16,200 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 59617
2013-10-31 20:27:16,200 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:16,205 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_59617_task____6y506/webapp
2013-10-31 20:27:16,357 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:59617
2013-10-31 20:27:16,358 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 20:27:16,358 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0
2013-10-31 20:27:16,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0045 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0042 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,403 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,404 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,408 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,409 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,410 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,411 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,412 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,413 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,414 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0007 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,416 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337636152
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,417 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,418 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,419 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,420 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,421 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,422 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,423 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,425 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,428 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,431 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,432 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,433 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,434 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,435 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,436 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0007 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:16,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337636179
2013-10-31 20:27:19,386 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/10.5.128.102
2013-10-31 20:27:19,390 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:35954 to host 10.5.128.102
2013-10-31 20:27:20,733 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 20:27:20,734 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 20:27:20,738 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 20:27:20,740 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:37249, blocks: 1, processing time: 0 msecs
2013-10-31 20:27:20,741 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 1 blocks took 1 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 20:27:21,366 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:21,368 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 20:27:21,370 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 20:27:21,371 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0
2013-10-31 20:27:21,400 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:21,402 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:21,402 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 52738: starting
2013-10-31 20:27:21,402 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 52738: starting
2013-10-31 20:27:21,404 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 52738: starting
2013-10-31 20:27:21,403 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 52738: starting
2013-10-31 20:27:21,405 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:52738
2013-10-31 20:27:21,405 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 52738: starting
2013-10-31 20:27:21,406 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:27:21,409 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4768fcbe
2013-10-31 20:27:21,409 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:27:21,410 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 20:27:21,433 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 20:27:21,435 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:21,435 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 34334 webServer.getConnectors()[0].getLocalPort() returned 34334
2013-10-31 20:27:21,435 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 34334
2013-10-31 20:27:21,435 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:21,440 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_34334_task____thqpkh/webapp
2013-10-31 20:27:21,590 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:34334
2013-10-31 20:27:21,591 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 20:27:21,591 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0
2013-10-31 20:27:21,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0045 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0042 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,636 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,637 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,638 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,640 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,641 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,642 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,643 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,644 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,645 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,646 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0007 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,647 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337641410
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,650 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,652 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,653 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,654 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,655 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,656 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,657 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,658 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,659 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,660 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,661 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,662 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,663 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,665 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,666 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0042 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,667 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,668 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,669 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,670 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,671 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,672 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,673 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:21,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337641424
2013-10-31 20:27:24,614 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:52738 to host 10.5.128.102
2013-10-31 20:27:26,596 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:26,598 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 20:27:26,600 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 20:27:26,601 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0
2013-10-31 20:27:26,629 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:26,629 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 46857: starting
2013-10-31 20:27:26,630 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 46857: starting
2013-10-31 20:27:26,631 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:46857
2013-10-31 20:27:26,632 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:46857
2013-10-31 20:27:26,631 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 46857: starting
2013-10-31 20:27:26,629 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:26,631 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 46857: starting
2013-10-31 20:27:26,631 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 46857: starting
2013-10-31 20:27:26,634 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7fe184a1
2013-10-31 20:27:26,634 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:46857
2013-10-31 20:27:26,635 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 20:27:26,656 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 20:27:26,657 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:26,658 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 34635 webServer.getConnectors()[0].getLocalPort() returned 34635
2013-10-31 20:27:26,658 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 34635
2013-10-31 20:27:26,658 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:26,663 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_34635_task____.iityvf/webapp
2013-10-31 20:27:26,814 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:34635
2013-10-31 20:27:26,814 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 20:27:26,815 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0
2013-10-31 20:27:26,815 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,817 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,818 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,819 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,821 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,822 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,824 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,825 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,827 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,829 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,830 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0045 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0042 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0007 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337646635
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0022 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,896 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,897 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,898 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,899 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,900 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,901 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,902 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,903 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,904 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,906 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,906 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,906 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:26,906 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337646647
2013-10-31 20:27:29,832 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:46857 to host 10.5.128.102
2013-10-31 20:27:31,822 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 20:27:31,824 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 20:27:31,825 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 20:27:31,826 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0
2013-10-31 20:27:31,856 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 20:27:31,857 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 20:27:31,858 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 55898: starting
2013-10-31 20:27:31,857 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 55898: starting
2013-10-31 20:27:31,860 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 55898: starting
2013-10-31 20:27:31,859 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 55898: starting
2013-10-31 20:27:31,861 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 55898: starting
2013-10-31 20:27:31,861 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:55898
2013-10-31 20:27:31,863 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:55898
2013-10-31 20:27:31,866 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2b62d9a6
2013-10-31 20:27:31,866 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:55898
2013-10-31 20:27:31,867 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 20:27:31,898 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 20:27:31,900 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 20:27:31,900 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 54828 webServer.getConnectors()[0].getLocalPort() returned 54828
2013-10-31 20:27:31,900 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 54828
2013-10-31 20:27:31,900 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 20:27:31,905 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_54828_task____.w11203/webapp
2013-10-31 20:27:32,148 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:54828
2013-10-31 20:27:32,149 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 20:27:32,150 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,152 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,152 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,152 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,153 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,153 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,153 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,153 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,154 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,154 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,154 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,154 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,154 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,155 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,155 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,155 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,155 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,156 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,156 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,156 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,156 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,157 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,157 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,157 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,157 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,158 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,158 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,158 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,158 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,159 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,159 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,159 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,159 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,160 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,160 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,161 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,161 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,161 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,162 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,162 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,162 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,163 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,163 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,163 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,163 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,164 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,164 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,164 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,164 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,164 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,165 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,165 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,165 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,165 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,166 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,166 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,166 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,166 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,167 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,167 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,167 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,167 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,168 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,168 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,168 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,168 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,168 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0045 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0042 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0014 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0036 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0021 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0007 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337651868
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0029 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0036 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0033 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0033 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0031 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0030 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0035 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0040 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0040 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200627733_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0012 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0044 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201607686_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0034 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0032 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0045 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,238 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0042 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,239 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0014 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,240 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,242 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,243 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0025 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0043 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,245 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,246 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200729837_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0041 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,247 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0024 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,248 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0029 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,250 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0043 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0017 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201240536_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031195355579_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0023 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0021 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,253 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202334094_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,254 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031194414610_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,255 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0005 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0009 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0010 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,256 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0030 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031184930965_0022 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0028 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0038 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031191217048_0027 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031201817366_0006 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031200859595_0001 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031193722736_0011 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:32,258 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383337651890
2013-10-31 20:27:35,163 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:55898 to host 10.5.128.102
2013-10-31 20:27:35,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:35,783 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt. blk_3037311813710157570_1002
2013-10-31 20:27:35,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3037311813710157570_1002 src: /127.0.0.1:33390 dest: /127.0.0.1:37249
2013-10-31 20:27:35,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3037311813710157570_1002 src: /127.0.0.1:43173 dest: /127.0.0.1:33202
2013-10-31 20:27:35,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3037311813710157570_1002 src: /127.0.0.1:38882 dest: /127.0.0.1:46399
2013-10-31 20:27:35,798 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:38882, dest: /127.0.0.1:46399, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3037311813710157570_1002, duration: 5242547
2013-10-31 20:27:35,799 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3037311813710157570_1002 terminating
2013-10-31 20:27:35,803 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43173, dest: /127.0.0.1:33202, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 8232542
2013-10-31 20:27:35,803 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3037311813710157570_1002 size 1449
2013-10-31 20:27:35,803 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3037311813710157570_1002 terminating
2013-10-31 20:27:35,807 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33390, dest: /127.0.0.1:37249, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3037311813710157570_1002, duration: 12101256
2013-10-31 20:27:35,807 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3037311813710157570_1002 size 1449
2013-10-31 20:27:35,807 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3037311813710157570_1002 terminating
2013-10-31 20:27:35,814 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3037311813710157570_1002 size 1449
2013-10-31 20:27:35,815 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt from client DFSClient_848976415
2013-10-31 20:27:35,815 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt is closed by DFSClient_848976415
2013-10-31 20:27:35,879 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:27:35,880 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:27:35,889 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: CC346CC581EB45A7B5405C4A09952B74
2013-10-31 20:27:36,008 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.2.0
2013-10-31 20:27:36,012 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 20:27:36,013 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 20:27:36,013 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["SequenceFile[[UNKNOWN]->['ip', 'count', 'boolean']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization"]
2013-10-31 20:27:36,014 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 20:27:36,014 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 20:27:36,014 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 20:27:36,015 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pesplatform/serialization
2013-10-31 20:27:36,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:27:36,139 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 20:27:36,140 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:27:36,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:27:36,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:27:36,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,180 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar. blk_-5377400272505376277_1003
2013-10-31 20:27:36,183 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5377400272505376277_1003 src: /127.0.0.1:34792 dest: /127.0.0.1:49827
2013-10-31 20:27:36,186 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5377400272505376277_1003 src: /127.0.0.1:43179 dest: /127.0.0.1:33202
2013-10-31 20:27:36,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5377400272505376277_1003 src: /127.0.0.1:38888 dest: /127.0.0.1:46399
2013-10-31 20:27:36,206 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:38888, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5377400272505376277_1003, duration: 15100096
2013-10-31 20:27:36,207 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5377400272505376277_1003 terminating
2013-10-31 20:27:36,210 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43179, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-5377400272505376277_1003, duration: 16547862
2013-10-31 20:27:36,211 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5377400272505376277_1003 terminating
2013-10-31 20:27:36,213 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-5377400272505376277_1003 size 238055
2013-10-31 20:27:36,215 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34792, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5377400272505376277_1003, duration: 21143893
2013-10-31 20:27:36,216 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-5377400272505376277_1003 size 238055
2013-10-31 20:27:36,216 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5377400272505376277_1003 terminating
2013-10-31 20:27:36,222 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5377400272505376277_1003 size 238055
2013-10-31 20:27:36,223 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar from client DFSClient_848976415
2013-10-31 20:27:36,223 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar is closed by DFSClient_848976415
2013-10-31 20:27:36,230 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar. New replication is 10
2013-10-31 20:27:36,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=null
2013-10-31 20:27:36,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,244 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:27:36,267 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2013-10-31 20:27:36,271 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:27:36,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:27:36,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,291 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split. New replication is 10
2013-10-31 20:27:36,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=null
2013-10-31 20:27:36,851 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split. blk_3767924587749921919_1004
2013-10-31 20:27:36,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3767924587749921919_1004 src: /127.0.0.1:38893 dest: /127.0.0.1:46399
2013-10-31 20:27:36,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3767924587749921919_1004 src: /127.0.0.1:34800 dest: /127.0.0.1:49827
2013-10-31 20:27:36,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3767924587749921919_1004 src: /127.0.0.1:33405 dest: /127.0.0.1:37249
2013-10-31 20:27:36,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3767924587749921919_1004 src: /127.0.0.1:43188 dest: /127.0.0.1:33202
2013-10-31 20:27:36,868 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43188, dest: /127.0.0.1:33202, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3767924587749921919_1004, duration: 5782018
2013-10-31 20:27:36,868 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3767924587749921919_1004 terminating
2013-10-31 20:27:36,870 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33405, dest: /127.0.0.1:37249, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3767924587749921919_1004, duration: 8298539
2013-10-31 20:27:36,871 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3767924587749921919_1004 size 1403
2013-10-31 20:27:36,871 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3767924587749921919_1004 terminating
2013-10-31 20:27:36,874 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3767924587749921919_1004 size 1403
2013-10-31 20:27:36,874 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34800, dest: /127.0.0.1:49827, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3767924587749921919_1004, duration: 11272425
2013-10-31 20:27:36,875 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3767924587749921919_1004 terminating
2013-10-31 20:27:36,877 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:38893, dest: /127.0.0.1:46399, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3767924587749921919_1004, duration: 14111876
2013-10-31 20:27:36,877 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3767924587749921919_1004 size 1403
2013-10-31 20:27:36,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3767924587749921919_1004 terminating
2013-10-31 20:27:36,882 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3767924587749921919_1004 size 1403
2013-10-31 20:27:36,882 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split from client DFSClient_848976415
2013-10-31 20:27:36,883 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split is closed by DFSClient_848976415
2013-10-31 20:27:36,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,925 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.splitmetainfo. blk_6214794221245643880_1005
2013-10-31 20:27:36,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6214794221245643880_1005 src: /127.0.0.1:38898 dest: /127.0.0.1:46399
2013-10-31 20:27:36,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6214794221245643880_1005 src: /127.0.0.1:43191 dest: /127.0.0.1:33202
2013-10-31 20:27:36,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6214794221245643880_1005 src: /127.0.0.1:33410 dest: /127.0.0.1:37249
2013-10-31 20:27:36,938 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33410, dest: /127.0.0.1:37249, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6214794221245643880_1005, duration: 3586612
2013-10-31 20:27:36,938 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6214794221245643880_1005 terminating
2013-10-31 20:27:36,938 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6214794221245643880_1005 size 156
2013-10-31 20:27:36,941 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43191, dest: /127.0.0.1:33202, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6214794221245643880_1005, duration: 6221677
2013-10-31 20:27:36,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6214794221245643880_1005 size 156
2013-10-31 20:27:36,941 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6214794221245643880_1005 terminating
2013-10-31 20:27:36,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:38898, dest: /127.0.0.1:46399, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6214794221245643880_1005, duration: 8453015
2013-10-31 20:27:36,946 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6214794221245643880_1005 terminating
2013-10-31 20:27:36,951 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:27:36,952 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:27:36,952 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6214794221245643880_1005 size 156
2013-10-31 20:27:36,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:36,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:37,126 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml. blk_9123205551798475194_1006
2013-10-31 20:27:37,128 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9123205551798475194_1006 src: /127.0.0.1:38903 dest: /127.0.0.1:46399
2013-10-31 20:27:37,129 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9123205551798475194_1006 src: /127.0.0.1:33414 dest: /127.0.0.1:37249
2013-10-31 20:27:37,130 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9123205551798475194_1006 src: /127.0.0.1:34811 dest: /127.0.0.1:49827
2013-10-31 20:27:37,133 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34811, dest: /127.0.0.1:49827, bytes: 28548, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_9123205551798475194_1006, duration: 2288092
2013-10-31 20:27:37,134 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9123205551798475194_1006 terminating
2013-10-31 20:27:37,135 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33414, dest: /127.0.0.1:37249, bytes: 28548, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_9123205551798475194_1006, duration: 3264936
2013-10-31 20:27:37,135 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9123205551798475194_1006 terminating
2013-10-31 20:27:37,137 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:38903, dest: /127.0.0.1:46399, bytes: 28548, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_9123205551798475194_1006, duration: 4897703
2013-10-31 20:27:37,137 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9123205551798475194_1006 terminating
2013-10-31 20:27:37,138 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_9123205551798475194_1006 size 28548
2013-10-31 20:27:37,139 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml from client DFSClient_848976415
2013-10-31 20:27:37,140 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml is closed by DFSClient_848976415
2013-10-31 20:27:37,140 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_9123205551798475194_1006 size 28548
2013-10-31 20:27:37,141 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_9123205551798475194_1006 size 28548
2013-10-31 20:27:37,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=null
2013-10-31 20:27:37,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33417, bytes: 28772, op: HDFS_READ, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_9123205551798475194_1006, duration: 1588643
2013-10-31 20:27:37,195 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0001: nMaps=4 nReduces=1 max=-1
2013-10-31 20:27:37,196 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0001 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:27:37,197 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0001
2013-10-31 20:27:37,198 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0001
2013-10-31 20:27:37,198 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0001 RESULT=SUCCESS
2013-10-31 20:27:37,200 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031202710049_0001
2013-10-31 20:27:37,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_1383251257155_hadoop_%5B94779AEE066141FFA7331043A2D49D77%2F582A27AB4C354B26 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:37,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:37,275 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_conf.xml. blk_-9037159349091662048_1008
2013-10-31 20:27:37,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9037159349091662048_1008 src: /127.0.0.1:33418 dest: /127.0.0.1:37249
2013-10-31 20:27:37,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9037159349091662048_1008 src: /127.0.0.1:34815 dest: /127.0.0.1:49827
2013-10-31 20:27:37,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9037159349091662048_1008 src: /127.0.0.1:38910 dest: /127.0.0.1:46399
2013-10-31 20:27:37,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:38910, dest: /127.0.0.1:46399, bytes: 28613, op: HDFS_WRITE, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-9037159349091662048_1008, duration: 5519810
2013-10-31 20:27:37,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9037159349091662048_1008 terminating
2013-10-31 20:27:37,288 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34815, dest: /127.0.0.1:49827, bytes: 28613, op: HDFS_WRITE, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-9037159349091662048_1008, duration: 4821433
2013-10-31 20:27:37,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-9037159349091662048_1008 size 28613
2013-10-31 20:27:37,288 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9037159349091662048_1008 terminating
2013-10-31 20:27:37,289 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33418, dest: /127.0.0.1:37249, bytes: 28613, op: HDFS_WRITE, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-9037159349091662048_1008, duration: 5697566
2013-10-31 20:27:37,289 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-9037159349091662048_1008 size 28613
2013-10-31 20:27:37,290 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9037159349091662048_1008 terminating
2013-10-31 20:27:37,291 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-9037159349091662048_1008 size 28613
2013-10-31 20:27:37,292 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_conf.xml from client DFSClient_-2113781216
2013-10-31 20:27:37,292 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_conf.xml is closed by DFSClient_-2113781216
2013-10-31 20:27:37,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:37,304 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken. blk_-1966753933755344052_1009
2013-10-31 20:27:37,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1966753933755344052_1009 src: /127.0.0.1:34818 dest: /127.0.0.1:49827
2013-10-31 20:27:37,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1966753933755344052_1009 src: /127.0.0.1:43205 dest: /127.0.0.1:33202
2013-10-31 20:27:37,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1966753933755344052_1009 src: /127.0.0.1:33424 dest: /127.0.0.1:37249
2013-10-31 20:27:37,310 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33424, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1966753933755344052_1009, duration: 1898570
2013-10-31 20:27:37,310 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1966753933755344052_1009 terminating
2013-10-31 20:27:37,311 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43205, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1966753933755344052_1009, duration: 2410263
2013-10-31 20:27:37,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1966753933755344052_1009 terminating
2013-10-31 20:27:37,312 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34818, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1966753933755344052_1009, duration: 3492614
2013-10-31 20:27:37,312 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1966753933755344052_1009 terminating
2013-10-31 20:27:37,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1966753933755344052_1009 size 116
2013-10-31 20:27:37,315 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken from client DFSClient_848976415
2013-10-31 20:27:37,316 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken is closed by DFSClient_848976415
2013-10-31 20:27:37,316 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1966753933755344052_1009 size 116
2013-10-31 20:27:37,316 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1966753933755344052_1009 size 116
2013-10-31 20:27:37,321 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken
2013-10-31 20:27:37,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.splitmetainfo dst=null perm=null
2013-10-31 20:27:37,327 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33426, bytes: 160, op: HDFS_READ, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6214794221245643880_1005, duration: 540531
2013-10-31 20:27:37,338 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0001 = 1449. Number of splits = 4
2013-10-31 20:27:37,338 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1
2013-10-31 20:27:37,339 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,339 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,339 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,339 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,340 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,340 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,340 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,340 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,341 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,341 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,341 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,341 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:27:37,342 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0001 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:27:37,344 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0001 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 20:27:37,379 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:49827 to replicate blk_-5377400272505376277_1003 to datanode(s) 127.0.0.1:37249
2013-10-31 20:27:37,471 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0001_m_000005_0' to tip task_20131031202710049_0001_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:27:37,476 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_m_000005_0 task's state:UNASSIGNED
2013-10-31 20:27:37,481 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_m_000005_0 which needs 1 slots
2013-10-31 20:27:37,481 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_m_000005_0 which needs 1 slots
2013-10-31 20:27:37,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken dst=null perm=null
2013-10-31 20:27:37,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43209, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1966753933755344052_1009, duration: 506192
2013-10-31 20:27:37,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=null
2013-10-31 20:27:37,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:34825, bytes: 28772, op: HDFS_READ, cliID: DFSClient_1717068254, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_9123205551798475194_1006, duration: 746539
2013-10-31 20:27:37,581 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:27:37,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=null
2013-10-31 20:27:37,611 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:34827, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1717068254, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5377400272505376277_1003, duration: 1811268
2013-10-31 20:27:37,759 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0001_m_1976995025
2013-10-31 20:27:37,759 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0001_m_1976995025 spawned.
2013-10-31 20:27:37,761 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0001/attempt_20131031202710049_0001_m_000005_0/taskjvm.sh
2013-10-31 20:27:38,016 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 66 raw values into 1 aggregated values, total 1
2013-10-31 20:27:39,039 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_m_1976995025 given task: attempt_20131031202710049_0001_m_000005_0
2013-10-31 20:27:39,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:27:40,016 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207) Starting thread to transfer block blk_-5377400272505376277_1003 to 127.0.0.1:37249
2013-10-31 20:27:40,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5377400272505376277_1003 src: /127.0.0.1:33449 dest: /127.0.0.1:37249
2013-10-31 20:27:40,022 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207):Transmitted block blk_-5377400272505376277_1003 to /127.0.0.1:37249
2013-10-31 20:27:40,025 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5377400272505376277_1003 src: /127.0.0.1:33449 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:27:40,030 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-5377400272505376277_1003 size 238055
2013-10-31 20:27:42,465 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000005_0 0.0% setup
2013-10-31 20:27:42,472 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_m_000005_0 is done.
2013-10-31 20:27:42,473 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_m_000005_0 was -1
2013-10-31 20:27:42,474 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:27:43,497 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_m_000005_0' has completed task_20131031202710049_0001_m_000005 successfully.
2013-10-31 20:27:43,510 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0001_m_000000_0' to tip task_20131031202710049_0001_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:27:43,512 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0001_m_000000
2013-10-31 20:27:43,515 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:27:43,516 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_m_000000_0 which needs 1 slots
2013-10-31 20:27:43,516 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_m_000000_0 which needs 1 slots
2013-10-31 20:27:43,558 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0001_m_318773650
2013-10-31 20:27:43,559 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0001_m_318773650 spawned.
2013-10-31 20:27:43,563 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0001/attempt_20131031202710049_0001_m_000000_0/taskjvm.sh
2013-10-31 20:27:44,178 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0001_m_000001_0' to tip task_20131031202710049_0001_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:27:44,181 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0001_m_000001
2013-10-31 20:27:44,183 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:27:44,184 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_m_000001_0 which needs 1 slots
2013-10-31 20:27:44,184 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_m_000001_0 which needs 1 slots
2013-10-31 20:27:44,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken dst=null perm=null
2013-10-31 20:27:44,192 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:34884, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1966753933755344052_1009, duration: 197798
2013-10-31 20:27:44,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=null
2013-10-31 20:27:44,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33490, bytes: 28772, op: HDFS_READ, cliID: DFSClient_-1310073694, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_9123205551798475194_1006, duration: 307754
2013-10-31 20:27:44,232 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:27:44,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=null
2013-10-31 20:27:44,254 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:38981, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1310073694, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5377400272505376277_1003, duration: 1402076
2013-10-31 20:27:44,328 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0001_m_-995358794
2013-10-31 20:27:44,328 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0001_m_-995358794 spawned.
2013-10-31 20:27:44,330 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0001/attempt_20131031202710049_0001_m_000001_0/taskjvm.sh
2013-10-31 20:27:44,568 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_m_318773650 given task: attempt_20131031202710049_0001_m_000000_0
2013-10-31 20:27:44,856 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0001_m_000002_0' to tip task_20131031202710049_0001_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:27:44,857 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0001_m_000002
2013-10-31 20:27:44,858 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:27:44,859 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_m_000002_0 which needs 1 slots
2013-10-31 20:27:44,859 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_m_000002_0 which needs 1 slots
2013-10-31 20:27:44,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken dst=null perm=null
2013-10-31 20:27:44,865 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43279, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1966753933755344052_1009, duration: 195503
2013-10-31 20:27:44,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=null
2013-10-31 20:27:44,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33499, bytes: 28772, op: HDFS_READ, cliID: DFSClient_1454970125, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_9123205551798475194_1006, duration: 313995
2013-10-31 20:27:44,894 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:27:44,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=null
2013-10-31 20:27:44,916 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33500, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1454970125, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-5377400272505376277_1003, duration: 1402506
2013-10-31 20:27:44,985 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0001_m_-693547091
2013-10-31 20:27:44,986 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0001_m_-693547091 spawned.
2013-10-31 20:27:44,987 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0001/attempt_20131031202710049_0001_m_000002_0/taskjvm.sh
2013-10-31 20:27:45,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=null
2013-10-31 20:27:45,255 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:34902, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3767924587749921919_1004, duration: 657686
2013-10-31 20:27:45,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:27:45,295 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43289, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000000_0, offset: 1024, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 210385
2013-10-31 20:27:45,339 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_m_-995358794 given task: attempt_20131031202710049_0001_m_000001_0
2013-10-31 20:27:45,650 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0001_m_000003_0' to tip task_20131031202710049_0001_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:27:45,650 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0001_m_000003
2013-10-31 20:27:45,652 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:27:45,652 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_m_000003_0 which needs 1 slots
2013-10-31 20:27:45,652 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_m_000003_0 which needs 1 slots
2013-10-31 20:27:45,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001/jobToken dst=null perm=null
2013-10-31 20:27:45,659 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43292, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1966753933755344052_1009, duration: 243054
2013-10-31 20:27:45,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.xml dst=null perm=null
2013-10-31 20:27:45,668 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33512, bytes: 28772, op: HDFS_READ, cliID: DFSClient_-1091520414, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_9123205551798475194_1006, duration: 276326
2013-10-31 20:27:45,687 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:27:45,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.jar dst=null perm=null
2013-10-31 20:27:45,711 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:34909, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1091520414, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5377400272505376277_1003, duration: 1376295
2013-10-31 20:27:45,785 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0001_m_-1524219966
2013-10-31 20:27:45,786 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0001_m_-1524219966 spawned.
2013-10-31 20:27:45,787 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0001/attempt_20131031202710049_0001_m_000003_0/taskjvm.sh
2013-10-31 20:27:45,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=null
2013-10-31 20:27:45,837 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39007, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3767924587749921919_1004, duration: 268692
2013-10-31 20:27:45,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:27:46,060 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_m_-693547091 given task: attempt_20131031202710049_0001_m_000002_0
2013-10-31 20:27:46,247 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33522, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000001_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3037311813710157570_1002, duration: 296777
2013-10-31 20:27:46,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=null
2013-10-31 20:27:46,562 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:34922, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000002_0, offset: 512, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3767924587749921919_1004, duration: 269590
2013-10-31 20:27:46,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:27:46,601 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43309, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000002_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 256712
2013-10-31 20:27:46,799 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_m_-1524219966 given task: attempt_20131031202710049_0001_m_000003_0
2013-10-31 20:27:47,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001/job.split dst=null perm=null
2013-10-31 20:27:47,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33535, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000003_0, offset: 1024, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3767924587749921919_1004, duration: 341635
2013-10-31 20:27:47,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:27:47,343 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39028, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0001_m_000003_0, offset: 512, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3037311813710157570_1002, duration: 856569
2013-10-31 20:27:48,176 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 20:27:48,182 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_m_000000_0 is done.
2013-10-31 20:27:48,182 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_m_000000_0 was 108
2013-10-31 20:27:48,182 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:27:48,516 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0001_m_000005_0
2013-10-31 20:27:48,517 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0001_m_000005_0
2013-10-31 20:27:48,517 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0001_m_000005_0 not found in cache
2013-10-31 20:27:48,766 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 20:27:48,772 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_m_000001_0 is done.
2013-10-31 20:27:48,772 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_m_000001_0 was 155
2013-10-31 20:27:48,773 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:27:49,488 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000002_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 20:27:49,494 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_m_000002_0 is done.
2013-10-31 20:27:49,494 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_m_000002_0 was 154
2013-10-31 20:27:49,495 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:27:49,525 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_m_000000_0' has completed task_20131031202710049_0001_m_000000 successfully.
2013-10-31 20:27:49,545 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0001_r_000000_0' to tip task_20131031202710049_0001_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:27:49,549 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:27:49,549 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_r_000000_0 which needs 1 slots
2013-10-31 20:27:49,549 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_r_000000_0 which needs 1 slots
2013-10-31 20:27:49,573 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0001_r_1976995025
2013-10-31 20:27:49,573 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0001_r_1976995025 spawned.
2013-10-31 20:27:49,575 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0001/attempt_20131031202710049_0001_r_000000_0/taskjvm.sh
2013-10-31 20:27:50,191 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_m_000001_0' has completed task_20131031202710049_0001_m_000001 successfully.
2013-10-31 20:27:50,227 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000003_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 20:27:50,229 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_m_000003_0 is done.
2013-10-31 20:27:50,229 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_m_000003_0 was 107
2013-10-31 20:27:50,230 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:27:50,641 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_r_1976995025 given task: attempt_20131031202710049_0001_r_000000_0
2013-10-31 20:27:50,863 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_m_000002_0' has completed task_20131031202710049_0001_m_000002 successfully.
2013-10-31 20:27:51,661 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_m_000003_0' has completed task_20131031202710049_0001_m_000003 successfully.
2013-10-31 20:27:56,430 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:52652, bytes: 108, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0001_m_000000_0, duration: 33140176
2013-10-31 20:27:56,456 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:52946, bytes: 155, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0001_m_000001_0, duration: 8354000
2013-10-31 20:27:56,476 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:44677, bytes: 154, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0001_m_000002_0, duration: 12731172
2013-10-31 20:27:56,497 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52282, bytes: 107, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0001_m_000003_0, duration: 13692734
2013-10-31 20:27:57,154 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:27:57,206 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:27:57,263 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:27:57,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:27:57,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:57,532 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0/part-00000. blk_-7982940896742994746_1010
2013-10-31 20:27:57,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982940896742994746_1010 src: /127.0.0.1:43406 dest: /127.0.0.1:33202
2013-10-31 20:27:57,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982940896742994746_1010 src: /127.0.0.1:39115 dest: /127.0.0.1:46399
2013-10-31 20:27:57,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982940896742994746_1010 src: /127.0.0.1:33626 dest: /127.0.0.1:37249
2013-10-31 20:27:57,580 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33626, dest: /127.0.0.1:37249, bytes: 342, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0001_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7982940896742994746_1010, duration: 3170796
2013-10-31 20:27:57,581 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7982940896742994746_1010 terminating
2013-10-31 20:27:57,583 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39115, dest: /127.0.0.1:46399, bytes: 342, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0001_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7982940896742994746_1010, duration: 4465233
2013-10-31 20:27:57,583 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7982940896742994746_1010 size 342
2013-10-31 20:27:57,583 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7982940896742994746_1010 terminating
2013-10-31 20:27:57,585 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43406, dest: /127.0.0.1:33202, bytes: 342, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0001_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7982940896742994746_1010, duration: 7405713
2013-10-31 20:27:57,585 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7982940896742994746_1010 size 342
2013-10-31 20:27:57,585 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7982940896742994746_1010 terminating
2013-10-31 20:27:57,586 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7982940896742994746_1010 size 342
2013-10-31 20:27:57,588 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0001_r_000000_0
2013-10-31 20:27:57,588 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0001_r_000000_0
2013-10-31 20:27:57,625 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0001_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:27:57,625 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:27:58,562 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031202710049_0001_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:27:58,566 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0001_r_000000_0
2013-10-31 20:27:58,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0 dst=null perm=null
2013-10-31 20:27:58,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:27:58,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:27:58,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary/_attempt_20131031202710049_0001_r_000000_0 dst=null perm=null
2013-10-31 20:28:00,207 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_r_000000_0 1.0% reduce > reduce
2013-10-31 20:28:00,210 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_r_000000_0 1.0% reduce > reduce
2013-10-31 20:28:00,211 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_r_000000_0 is done.
2013-10-31 20:28:00,211 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_r_000000_0 was -1
2013-10-31 20:28:00,212 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:01,573 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_r_000000_0' has completed task_20131031202710049_0001_r_000000 successfully.
2013-10-31 20:28:01,581 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0001_m_000004_0' to tip task_20131031202710049_0001_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:28:01,583 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0001_m_000004_0 task's state:UNASSIGNED
2013-10-31 20:28:01,584 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0001_m_000004_0 which needs 1 slots
2013-10-31 20:28:01,584 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0001_m_000004_0 which needs 1 slots
2013-10-31 20:28:01,620 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0001/attempt_20131031202710049_0001_m_000004_0. Attempting to reuse: jvm_20131031202710049_0001_m_1976995025
2013-10-31 20:28:02,556 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0001_m_1976995025 given task: attempt_20131031202710049_0001_m_000004_0
2013-10-31 20:28:02,665 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000004_0 0.0%
2013-10-31 20:28:02,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary dst=null perm=null
2013-10-31 20:28:02,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:02,691 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_SUCCESS from client DFSClient_attempt_20131031202710049_0001_m_000004_0
2013-10-31 20:28:02,691 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0001_m_000004_0
2013-10-31 20:28:02,698 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5377400272505376277 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:02,698 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5377400272505376277 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:02,698 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5377400272505376277 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:02,698 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5377400272505376277 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3767924587749921919 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3767924587749921919 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3767924587749921919 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3767924587749921919 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6214794221245643880 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6214794221245643880 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6214794221245643880 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9123205551798475194 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:02,699 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9123205551798475194 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:02,700 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9123205551798475194 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:02,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0001 dst=null perm=null
2013-10-31 20:28:04,384 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_6214794221245643880_1005 blk_9123205551798475194_1006 blk_-5377400272505376277_1003 blk_3767924587749921919_1004
2013-10-31 20:28:04,384 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_6214794221245643880_1005 blk_-5377400272505376277_1003 blk_3767924587749921919_1004
2013-10-31 20:28:05,629 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0001_m_000004_0 0.0% cleanup
2013-10-31 20:28:05,632 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0001_m_000004_0 is done.
2013-10-31 20:28:05,633 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0001_m_000004_0 was -1
2013-10-31 20:28:05,633 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:06,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5377400272505376277_1003 file build/test/data/dfs/data/data3/current/blk_-5377400272505376277 for deletion
2013-10-31 20:28:06,198 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3767924587749921919_1004 file build/test/data/dfs/data/data4/current/blk_3767924587749921919 for deletion
2013-10-31 20:28:06,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6214794221245643880_1005 file build/test/data/dfs/data/data3/current/blk_6214794221245643880 for deletion
2013-10-31 20:28:06,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5377400272505376277_1003 at file build/test/data/dfs/data/data3/current/blk_-5377400272505376277
2013-10-31 20:28:06,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3767924587749921919_1004 at file build/test/data/dfs/data/data4/current/blk_3767924587749921919
2013-10-31 20:28:06,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6214794221245643880_1005 at file build/test/data/dfs/data/data3/current/blk_6214794221245643880
2013-10-31 20:28:06,584 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0001_r_000000_0
2013-10-31 20:28:06,584 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0001_r_000000_0
2013-10-31 20:28:06,639 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5377400272505376277_1003 file build/test/data/dfs/data/data6/current/blk_-5377400272505376277 for deletion
2013-10-31 20:28:06,640 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3767924587749921919_1004 file build/test/data/dfs/data/data5/current/blk_3767924587749921919 for deletion
2013-10-31 20:28:06,640 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6214794221245643880_1005 file build/test/data/dfs/data/data6/current/blk_6214794221245643880 for deletion
2013-10-31 20:28:06,641 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5377400272505376277_1003 at file build/test/data/dfs/data/data6/current/blk_-5377400272505376277
2013-10-31 20:28:06,641 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9123205551798475194_1006 file build/test/data/dfs/data/data5/current/blk_9123205551798475194 for deletion
2013-10-31 20:28:06,641 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6214794221245643880_1005 at file build/test/data/dfs/data/data6/current/blk_6214794221245643880
2013-10-31 20:28:06,641 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3767924587749921919_1004 at file build/test/data/dfs/data/data5/current/blk_3767924587749921919
2013-10-31 20:28:06,642 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9123205551798475194_1006 at file build/test/data/dfs/data/data5/current/blk_9123205551798475194
2013-10-31 20:28:06,752 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_6920487667347938972_1001
2013-10-31 20:28:07,384 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_9123205551798475194_1006 blk_-5377400272505376277_1003 blk_3767924587749921919_1004
2013-10-31 20:28:07,385 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_6214794221245643880_1005 blk_9123205551798475194_1006 blk_-5377400272505376277_1003 blk_3767924587749921919_1004
2013-10-31 20:28:07,592 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0001_m_000004_0' has completed task_20131031202710049_0001_m_000004 successfully.
2013-10-31 20:28:07,595 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0001 has completed successfully.
2013-10-31 20:28:07,600 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0001,submitTime=1383251257155,launchTime=1383251257342,firstMapTaskLaunchTime=1383251263509,firstReduceTaskLaunchTime=1383251269537,firstJobSetupTaskLaunchTime=1383251257439,firstJobCleanupTaskLaunchTime=1383251281580,finishTime=1383251287595,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=26,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[94779AEE066141FFA7331043A2D49D77/582A27AB4C354B268E8707BA4DEA480A] test/(1/1) ...pesplatform/serialization
2013-10-31 20:28:07,607 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_1383251257155_hadoop_%5B94779AEE066141FFA7331043A2D49D77%2F582A27AB4C354B26. blk_1923996118185355645_1011
2013-10-31 20:28:07,611 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1923996118185355645_1011 src: /127.0.0.1:35102 dest: /127.0.0.1:49827
2013-10-31 20:28:07,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1923996118185355645_1011 src: /127.0.0.1:43489 dest: /127.0.0.1:33202
2013-10-31 20:28:07,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1923996118185355645_1011 src: /127.0.0.1:39198 dest: /127.0.0.1:46399
2013-10-31 20:28:07,622 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39198, dest: /127.0.0.1:46399, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1923996118185355645_1011, duration: 5481764
2013-10-31 20:28:07,623 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1923996118185355645_1011 terminating
2013-10-31 20:28:07,624 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43489, dest: /127.0.0.1:33202, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1923996118185355645_1011, duration: 6608886
2013-10-31 20:28:07,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1923996118185355645_1011 terminating
2013-10-31 20:28:07,626 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35102, dest: /127.0.0.1:49827, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-2113781216, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1923996118185355645_1011, duration: 6586152
2013-10-31 20:28:07,626 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1923996118185355645_1011 terminating
2013-10-31 20:28:07,626 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_1923996118185355645_1011 size 28316
2013-10-31 20:28:07,629 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_1383251257155_hadoop_%5B94779AEE066141FFA7331043A2D49D77%2F582A27AB4C354B26 from client DFSClient_-2113781216
2013-10-31 20:28:07,630 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_logs/history/job_20131031202710049_0001_1383251257155_hadoop_%5B94779AEE066141FFA7331043A2D49D77%2F582A27AB4C354B26 is closed by DFSClient_-2113781216
2013-10-31 20:28:07,630 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 71 Total time for transactions(ms): 5Number of transactions batched in Syncs: 2 Number of syncs: 39 SyncTimes(ms): 964 231
2013-10-31 20:28:07,630 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_1923996118185355645_1011 size 28316
2013-10-31 20:28:07,631 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_1923996118185355645_1011 size 28316
2013-10-31 20:28:07,642 INFO mapred.JobHistory (JobHistory.java:maybeMakeSubdirectory(403)) - Creating DONE subfolder at file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:28:07,644 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_m_000000_0'
2013-10-31 20:28:07,645 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_m_000004_0'
2013-10-31 20:28:07,645 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0001_1383251257155_hadoop_%5B94779AEE066141FFA7331043A2D49D77%2F582A27AB4C354B26 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:28:07,645 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_m_000005_0'
2013-10-31 20:28:07,645 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_r_000000_0'
2013-10-31 20:28:07,648 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1966753933755344052 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:07,648 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1966753933755344052 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:07,648 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1966753933755344052 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:07,655 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0001_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:28:07,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0001 dst=null perm=null
2013-10-31 20:28:07,662 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/_temporary
2013-10-31 20:28:07,688 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:07,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:28:07,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:28:07,705 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43492, bytes: 1461, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 339037
2013-10-31 20:28:07,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization dst=null perm=null
2013-10-31 20:28:07,715 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:07,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/part-00000 dst=null perm=null
2013-10-31 20:28:07,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/part-00000 dst=null perm=null
2013-10-31 20:28:07,724 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39201, bytes: 346, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7982940896742994746_1010, duration: 364234
2013-10-31 20:28:07,736 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/serialization
2013-10-31 20:28:07,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization dst=null perm=null
2013-10-31 20:28:07,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/serialization/part-00000 dst=null perm=null
2013-10-31 20:28:07,743 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33712, bytes: 346, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7982940896742994746_1010, duration: 356193
2013-10-31 20:28:07,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:07,752 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt. blk_-1710730409183361578_1012
2013-10-31 20:28:07,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1710730409183361578_1012 src: /127.0.0.1:39203 dest: /127.0.0.1:46399
2013-10-31 20:28:07,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1710730409183361578_1012 src: /127.0.0.1:33714 dest: /127.0.0.1:37249
2013-10-31 20:28:07,756 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1710730409183361578_1012 src: /127.0.0.1:35111 dest: /127.0.0.1:49827
2013-10-31 20:28:07,759 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35111, dest: /127.0.0.1:49827, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 768131
2013-10-31 20:28:07,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1710730409183361578_1012 terminating
2013-10-31 20:28:07,760 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33714, dest: /127.0.0.1:37249, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 1684788
2013-10-31 20:28:07,760 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1710730409183361578_1012 size 19
2013-10-31 20:28:07,761 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1710730409183361578_1012 terminating
2013-10-31 20:28:07,762 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39203, dest: /127.0.0.1:46399, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1710730409183361578_1012, duration: 3728578
2013-10-31 20:28:07,762 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1710730409183361578_1012 terminating
2013-10-31 20:28:07,762 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1710730409183361578_1012 size 19
2013-10-31 20:28:07,764 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1710730409183361578_1012 size 19
2013-10-31 20:28:07,764 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt from client DFSClient_848976415
2013-10-31 20:28:07,764 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt is closed by DFSClient_848976415
2013-10-31 20:28:07,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:07,784 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt. blk_4376294229090259720_1013
2013-10-31 20:28:07,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4376294229090259720_1013 src: /127.0.0.1:33716 dest: /127.0.0.1:37249
2013-10-31 20:28:07,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4376294229090259720_1013 src: /127.0.0.1:39207 dest: /127.0.0.1:46399
2013-10-31 20:28:07,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4376294229090259720_1013 src: /127.0.0.1:43500 dest: /127.0.0.1:33202
2013-10-31 20:28:07,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43500, dest: /127.0.0.1:33202, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4376294229090259720_1013, duration: 809847
2013-10-31 20:28:07,794 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4376294229090259720_1013 terminating
2013-10-31 20:28:07,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39207, dest: /127.0.0.1:46399, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 2349837
2013-10-31 20:28:07,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_4376294229090259720_1013 size 19
2013-10-31 20:28:07,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4376294229090259720_1013 terminating
2013-10-31 20:28:07,797 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33716, dest: /127.0.0.1:37249, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4376294229090259720_1013, duration: 4420695
2013-10-31 20:28:07,798 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4376294229090259720_1013 terminating
2013-10-31 20:28:07,800 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_4376294229090259720_1013 size 19
2013-10-31 20:28:07,801 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt from client DFSClient_848976415
2013-10-31 20:28:07,801 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt is closed by DFSClient_848976415
2013-10-31 20:28:07,802 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_4376294229090259720_1013 size 19
2013-10-31 20:28:07,830 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:28:07,830 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:28:07,859 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:28:07,860 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:28:07,861 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:28:07,861 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[[UNKNOWN]->[0:7]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue"]
2013-10-31 20:28:07,862 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:28:07,862 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 20:28:07,862 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 20:28:07,863 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...platform/writablekeyvalue
2013-10-31 20:28:07,870 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 20:28:07,871 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:28:07,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:28:07,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:28:07,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:07,899 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar. blk_838393126428988157_1014
2013-10-31 20:28:07,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_838393126428988157_1014 src: /127.0.0.1:33721 dest: /127.0.0.1:37249
2013-10-31 20:28:07,902 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_838393126428988157_1014 src: /127.0.0.1:43504 dest: /127.0.0.1:33202
2013-10-31 20:28:07,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_838393126428988157_1014 src: /127.0.0.1:39213 dest: /127.0.0.1:46399
2013-10-31 20:28:07,916 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39213, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_838393126428988157_1014, duration: 8908939
2013-10-31 20:28:07,917 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_838393126428988157_1014 terminating
2013-10-31 20:28:07,918 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43504, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_838393126428988157_1014, duration: 10434189
2013-10-31 20:28:07,918 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_838393126428988157_1014 terminating
2013-10-31 20:28:07,920 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33721, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_838393126428988157_1014, duration: 12169399
2013-10-31 20:28:07,920 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_838393126428988157_1014 terminating
2013-10-31 20:28:07,921 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_838393126428988157_1014 size 238055
2013-10-31 20:28:07,922 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_838393126428988157_1014 size 238055
2013-10-31 20:28:07,923 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_838393126428988157_1014 size 238055
2013-10-31 20:28:07,923 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar from client DFSClient_848976415
2013-10-31 20:28:07,924 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar is closed by DFSClient_848976415
2013-10-31 20:28:08,042 INFO metrics.MetricsUtil (?:emrClusterStarted(?)) - instance controller state completed
2013-10-31 20:28:08,059 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:28:08,071 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:28:08,077 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:28:08,083 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:28:08,090 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:28:08,096 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:28:08,102 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:28:08,102 INFO metrics.MetricsSaver (?:flush(?)) - Discard 43 records
2013-10-31 20:28:08,218 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_m_000001_0'
2013-10-31 20:28:08,415 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar. New replication is 10
2013-10-31 20:28:08,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar dst=null perm=null
2013-10-31 20:28:08,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,427 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:28:08,434 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:08,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:08,439 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:08,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:08,443 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:08,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:08,448 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:08,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:08,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,465 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split. New replication is 10
2013-10-31 20:28:08,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:08,474 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split. blk_8120752034950361120_1015
2013-10-31 20:28:08,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8120752034950361120_1015 src: /127.0.0.1:35125 dest: /127.0.0.1:49827
2013-10-31 20:28:08,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8120752034950361120_1015 src: /127.0.0.1:33730 dest: /127.0.0.1:37249
2013-10-31 20:28:08,479 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8120752034950361120_1015 src: /127.0.0.1:43513 dest: /127.0.0.1:33202
2013-10-31 20:28:08,481 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8120752034950361120_1015 src: /127.0.0.1:39222 dest: /127.0.0.1:46399
2013-10-31 20:28:08,486 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39222, dest: /127.0.0.1:46399, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8120752034950361120_1015, duration: 2044626
2013-10-31 20:28:08,486 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8120752034950361120_1015 terminating
2013-10-31 20:28:08,487 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43513, dest: /127.0.0.1:33202, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8120752034950361120_1015, duration: 3507373
2013-10-31 20:28:08,488 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8120752034950361120_1015 terminating
2013-10-31 20:28:08,489 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8120752034950361120_1015 size 2077
2013-10-31 20:28:08,489 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33730, dest: /127.0.0.1:37249, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8120752034950361120_1015, duration: 4368131
2013-10-31 20:28:08,489 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8120752034950361120_1015 terminating
2013-10-31 20:28:08,491 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35125, dest: /127.0.0.1:49827, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8120752034950361120_1015, duration: 6589987
2013-10-31 20:28:08,491 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_8120752034950361120_1015 size 2077
2013-10-31 20:28:08,491 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8120752034950361120_1015 terminating
2013-10-31 20:28:08,494 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8120752034950361120_1015 size 2077
2013-10-31 20:28:08,495 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split from client DFSClient_848976415
2013-10-31 20:28:08,495 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split is closed by DFSClient_848976415
2013-10-31 20:28:08,495 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8120752034950361120_1015 size 2077
2013-10-31 20:28:08,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,517 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.splitmetainfo. blk_2577477730557176247_1016
2013-10-31 20:28:08,519 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577477730557176247_1016 src: /127.0.0.1:33733 dest: /127.0.0.1:37249
2013-10-31 20:28:08,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577477730557176247_1016 src: /127.0.0.1:39224 dest: /127.0.0.1:46399
2013-10-31 20:28:08,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577477730557176247_1016 src: /127.0.0.1:35131 dest: /127.0.0.1:49827
2013-10-31 20:28:08,526 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35131, dest: /127.0.0.1:49827, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2577477730557176247_1016, duration: 821804
2013-10-31 20:28:08,527 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2577477730557176247_1016 terminating
2013-10-31 20:28:08,528 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39224, dest: /127.0.0.1:46399, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2577477730557176247_1016, duration: 2562271
2013-10-31 20:28:08,529 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2577477730557176247_1016 terminating
2013-10-31 20:28:08,530 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33733, dest: /127.0.0.1:37249, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2577477730557176247_1016, duration: 4560058
2013-10-31 20:28:08,531 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2577477730557176247_1016 size 218
2013-10-31 20:28:08,531 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2577477730557176247_1016 terminating
2013-10-31 20:28:08,533 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:28:08,533 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:28:08,534 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2577477730557176247_1016 size 218
2013-10-31 20:28:08,535 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2577477730557176247_1016 size 218
2013-10-31 20:28:08,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,565 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml. blk_1826761299642014135_1017
2013-10-31 20:28:08,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1826761299642014135_1017 src: /127.0.0.1:35132 dest: /127.0.0.1:49827
2013-10-31 20:28:08,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1826761299642014135_1017 src: /127.0.0.1:39227 dest: /127.0.0.1:46399
2013-10-31 20:28:08,571 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1826761299642014135_1017 src: /127.0.0.1:33738 dest: /127.0.0.1:37249
2013-10-31 20:28:08,579 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33738, dest: /127.0.0.1:37249, bytes: 29116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1826761299642014135_1017, duration: 2759662
2013-10-31 20:28:08,580 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1826761299642014135_1017 terminating
2013-10-31 20:28:08,580 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_1826761299642014135_1017 size 29116
2013-10-31 20:28:08,581 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39227, dest: /127.0.0.1:46399, bytes: 29116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1826761299642014135_1017, duration: 3727687
2013-10-31 20:28:08,581 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1826761299642014135_1017 terminating
2013-10-31 20:28:08,582 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35132, dest: /127.0.0.1:49827, bytes: 29116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1826761299642014135_1017, duration: 4840232
2013-10-31 20:28:08,582 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1826761299642014135_1017 terminating
2013-10-31 20:28:08,587 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_1826761299642014135_1017 size 29116
2013-10-31 20:28:08,587 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml from client DFSClient_848976415
2013-10-31 20:28:08,588 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml is closed by DFSClient_848976415
2013-10-31 20:28:08,588 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_1826761299642014135_1017 size 29116
2013-10-31 20:28:08,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml dst=null perm=null
2013-10-31 20:28:08,603 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39230, bytes: 29344, op: HDFS_READ, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1826761299642014135_1017, duration: 232437
2013-10-31 20:28:08,615 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0002: nMaps=6 nReduces=1 max=-1
2013-10-31 20:28:08,616 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0002 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:28:08,616 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0002 RESULT=SUCCESS
2013-10-31 20:28:08,617 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0002
2013-10-31 20:28:08,618 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0002
2013-10-31 20:28:08,619 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0002
2013-10-31 20:28:08,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_1383251288592_hadoop_%5BD5AAB94451CA4C5A9B5B1CF6ACDB08D6%2FCB53F6FD13754CCF dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:08,655 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_conf.xml. blk_-4639033224500091078_1019
2013-10-31 20:28:08,655 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4639033224500091078_1019 src: /127.0.0.1:33741 dest: /127.0.0.1:37249
2013-10-31 20:28:08,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4639033224500091078_1019 src: /127.0.0.1:39232 dest: /127.0.0.1:46399
2013-10-31 20:28:08,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4639033224500091078_1019 src: /127.0.0.1:43525 dest: /127.0.0.1:33202
2013-10-31 20:28:08,660 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43525, dest: /127.0.0.1:33202, bytes: 29181, op: HDFS_WRITE, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4639033224500091078_1019, duration: 772098
2013-10-31 20:28:08,661 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4639033224500091078_1019 terminating
2013-10-31 20:28:08,662 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4639033224500091078_1019 size 29181
2013-10-31 20:28:08,662 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39232, dest: /127.0.0.1:46399, bytes: 29181, op: HDFS_WRITE, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4639033224500091078_1019, duration: 2682577
2013-10-31 20:28:08,663 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4639033224500091078_1019 size 29181
2013-10-31 20:28:08,663 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4639033224500091078_1019 terminating
2013-10-31 20:28:08,665 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33741, dest: /127.0.0.1:37249, bytes: 29181, op: HDFS_WRITE, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4639033224500091078_1019, duration: 5346557
2013-10-31 20:28:08,665 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4639033224500091078_1019 terminating
2013-10-31 20:28:08,669 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4639033224500091078_1019 size 29181
2013-10-31 20:28:08,669 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_conf.xml from client DFSClient_-1550863639
2013-10-31 20:28:08,670 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_conf.xml is closed by DFSClient_-1550863639
2013-10-31 20:28:08,751 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5377400272505376277_1003 file build/test/data/dfs/data/data2/current/blk_-5377400272505376277 for deletion
2013-10-31 20:28:08,752 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3767924587749921919_1004 file build/test/data/dfs/data/data1/current/blk_3767924587749921919 for deletion
2013-10-31 20:28:08,752 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6214794221245643880_1005 file build/test/data/dfs/data/data2/current/blk_6214794221245643880 for deletion
2013-10-31 20:28:08,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3767924587749921919_1004 at file build/test/data/dfs/data/data1/current/blk_3767924587749921919
2013-10-31 20:28:08,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5377400272505376277_1003 at file build/test/data/dfs/data/data2/current/blk_-5377400272505376277
2013-10-31 20:28:08,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9123205551798475194_1006 file build/test/data/dfs/data/data1/current/blk_9123205551798475194 for deletion
2013-10-31 20:28:08,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6214794221245643880_1005 at file build/test/data/dfs/data/data2/current/blk_6214794221245643880
2013-10-31 20:28:08,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9123205551798475194_1006 at file build/test/data/dfs/data/data1/current/blk_9123205551798475194
2013-10-31 20:28:08,888 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_m_000002_0'
2013-10-31 20:28:09,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:09,183 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken. blk_3341029547036692733_1020
2013-10-31 20:28:09,184 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3341029547036692733_1020 src: /127.0.0.1:43528 dest: /127.0.0.1:33202
2013-10-31 20:28:09,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3341029547036692733_1020 src: /127.0.0.1:35143 dest: /127.0.0.1:49827
2013-10-31 20:28:09,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3341029547036692733_1020 src: /127.0.0.1:39238 dest: /127.0.0.1:46399
2013-10-31 20:28:09,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39238, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3341029547036692733_1020, duration: 2518338
2013-10-31 20:28:09,193 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3341029547036692733_1020 terminating
2013-10-31 20:28:09,195 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35143, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3341029547036692733_1020, duration: 4013605
2013-10-31 20:28:09,195 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3341029547036692733_1020 terminating
2013-10-31 20:28:09,197 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43528, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3341029547036692733_1020, duration: 5414530
2013-10-31 20:28:09,198 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3341029547036692733_1020 size 116
2013-10-31 20:28:09,198 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3341029547036692733_1020 terminating
2013-10-31 20:28:09,201 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3341029547036692733_1020 size 116
2013-10-31 20:28:09,201 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken from client DFSClient_848976415
2013-10-31 20:28:09,201 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken is closed by DFSClient_848976415
2013-10-31 20:28:09,202 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3341029547036692733_1020 size 116
2013-10-31 20:28:09,206 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken
2013-10-31 20:28:09,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.splitmetainfo dst=null perm=null
2013-10-31 20:28:09,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39239, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2577477730557176247_1016, duration: 609397
2013-10-31 20:28:09,216 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0002 = 38. Number of splits = 6
2013-10-31 20:28:09,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,218 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,218 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,218 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,218 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,219 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,219 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,219 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,219 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,219 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,220 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,220 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,220 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,220 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,220 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0002_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:09,221 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0002 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:28:09,221 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0002 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 20:28:09,689 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0002_m_000007_0' to tip task_20131031202710049_0002_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:28:09,694 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0001_m_000003_0'
2013-10-31 20:28:09,696 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000007_0 task's state:UNASSIGNED
2013-10-31 20:28:09,696 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000007_0 which needs 1 slots
2013-10-31 20:28:09,696 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0002_m_000007_0 which needs 1 slots
2013-10-31 20:28:09,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken dst=null perm=null
2013-10-31 20:28:09,708 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39245, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3341029547036692733_1020, duration: 383349
2013-10-31 20:28:09,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml dst=null perm=null
2013-10-31 20:28:09,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35153, bytes: 29344, op: HDFS_READ, cliID: DFSClient_409973550, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1826761299642014135_1017, duration: 586088
2013-10-31 20:28:09,754 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:28:09,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar dst=null perm=null
2013-10-31 20:28:09,772 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33758, bytes: 239915, op: HDFS_READ, cliID: DFSClient_409973550, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_838393126428988157_1014, duration: 1172426
2013-10-31 20:28:09,870 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_m_1148474272
2013-10-31 20:28:09,870 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_m_1148474272 spawned.
2013-10-31 20:28:09,873 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_m_000007_0/taskjvm.sh
2013-10-31 20:28:10,024 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5377400272505376277_1003 file build/test/data/dfs/data/data8/current/blk_-5377400272505376277 for deletion
2013-10-31 20:28:10,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3767924587749921919_1004 file build/test/data/dfs/data/data7/current/blk_3767924587749921919 for deletion
2013-10-31 20:28:10,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9123205551798475194_1006 file build/test/data/dfs/data/data8/current/blk_9123205551798475194 for deletion
2013-10-31 20:28:10,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5377400272505376277_1003 at file build/test/data/dfs/data/data8/current/blk_-5377400272505376277
2013-10-31 20:28:10,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3767924587749921919_1004 at file build/test/data/dfs/data/data7/current/blk_3767924587749921919
2013-10-31 20:28:10,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9123205551798475194_1006 at file build/test/data/dfs/data/data8/current/blk_9123205551798475194
2013-10-31 20:28:10,386 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:33202 to replicate blk_838393126428988157_1014 to datanode(s) 127.0.0.1:49827
2013-10-31 20:28:10,386 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-1966753933755344052_1009
2013-10-31 20:28:10,386 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-1966753933755344052_1009
2013-10-31 20:28:11,711 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_1148474272 given task: attempt_20131031202710049_0002_m_000007_0
2013-10-31 20:28:12,198 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909) Starting thread to transfer block blk_838393126428988157_1014 to 127.0.0.1:49827
2013-10-31 20:28:12,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1966753933755344052_1009 file build/test/data/dfs/data/data4/current/blk_-1966753933755344052 for deletion
2013-10-31 20:28:12,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1966753933755344052_1009 at file build/test/data/dfs/data/data4/current/blk_-1966753933755344052
2013-10-31 20:28:12,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_838393126428988157_1014 src: /127.0.0.1:35175 dest: /127.0.0.1:49827
2013-10-31 20:28:12,200 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909):Transmitted block blk_838393126428988157_1014 to /127.0.0.1:49827
2013-10-31 20:28:12,201 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_838393126428988157_1014 src: /127.0.0.1:35175 dest: /127.0.0.1:49827 of size 238055
2013-10-31 20:28:12,204 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_838393126428988157_1014 size 238055
2013-10-31 20:28:12,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:28:12,648 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0001
2013-10-31 20:28:12,648 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0001_m_000004_0 not found in cache
2013-10-31 20:28:12,651 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0001 for user-log deletion with retainTimeStamp:1383337692651
2013-10-31 20:28:12,753 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0001_r_1976995025 since job job_20131031202710049_0001 is dead
2013-10-31 20:28:12,766 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25201 with signal TERM. Exit code 0
2013-10-31 20:28:12,767 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0001_m_318773650 since job job_20131031202710049_0001 is dead
2013-10-31 20:28:12,777 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24912 with signal TERM. Exit code 0
2013-10-31 20:28:12,932 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:12,932 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:12,932 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:12,932 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0001_r_1976995025 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:12,988 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:12,989 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:12,989 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:12,989 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0001_m_318773650 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:13,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1966753933755344052_1009 file build/test/data/dfs/data/data8/current/blk_-1966753933755344052 for deletion
2013-10-31 20:28:13,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1966753933755344052_1009 at file build/test/data/dfs/data/data8/current/blk_-1966753933755344052
2013-10-31 20:28:13,219 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0001
2013-10-31 20:28:13,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0001 for user-log deletion with retainTimeStamp:1383337693221
2013-10-31 20:28:13,372 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0001_m_-995358794 since job job_20131031202710049_0001 is dead
2013-10-31 20:28:13,382 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24968 with signal TERM. Exit code 0
2013-10-31 20:28:13,387 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-1966753933755344052_1009
2013-10-31 20:28:13,585 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:13,585 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:13,585 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:13,586 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0001_m_-995358794 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:13,674 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0001_m_1976995025 since job job_20131031202710049_0001 is dead
2013-10-31 20:28:13,684 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24850 with signal TERM. Exit code 0
2013-10-31 20:28:13,868 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:13,869 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:13,869 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:13,869 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0001_m_1976995025 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:28:13,889 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0001
2013-10-31 20:28:13,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0001 for user-log deletion with retainTimeStamp:1383337693891
2013-10-31 20:28:14,085 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0001_m_-693547091 since job job_20131031202710049_0001 is dead
2013-10-31 20:28:14,095 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25035 with signal TERM. Exit code 0
2013-10-31 20:28:14,307 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:14,307 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:14,307 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:14,308 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0001_m_-693547091 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:14,696 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0001
2013-10-31 20:28:14,699 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0001 for user-log deletion with retainTimeStamp:1383337694699
2013-10-31 20:28:14,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1966753933755344052_1009 file build/test/data/dfs/data/data1/current/blk_-1966753933755344052 for deletion
2013-10-31 20:28:14,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1966753933755344052_1009 at file build/test/data/dfs/data/data1/current/blk_-1966753933755344052
2013-10-31 20:28:14,797 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0001_m_-1524219966 since job job_20131031202710049_0001 is dead
2013-10-31 20:28:14,806 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25108 with signal TERM. Exit code 0
2013-10-31 20:28:15,004 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:15,004 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:15,004 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:15,004 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0001_m_-1524219966 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:15,153 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000007_0 0.0% setup
2013-10-31 20:28:15,157 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000007_0 is done.
2013-10-31 20:28:15,158 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000007_0 was -1
2013-10-31 20:28:15,158 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:15,705 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000007_0' has completed task_20131031202710049_0002_m_000007 successfully.
2013-10-31 20:28:15,711 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0002_m_000000_0' to tip task_20131031202710049_0002_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:28:15,712 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0002_m_000000
2013-10-31 20:28:15,713 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0002_m_000001_0' to tip task_20131031202710049_0002_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:28:15,713 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0002_m_000001
2013-10-31 20:28:15,716 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:28:15,717 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:28:15,717 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000000_0 which needs 1 slots
2013-10-31 20:28:15,717 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0002_m_000000_0 which needs 1 slots
2013-10-31 20:28:15,718 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000001_0 which needs 1 slots
2013-10-31 20:28:15,718 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0002_m_000001_0 which needs 1 slots
2013-10-31 20:28:15,756 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_m_-459265034
2013-10-31 20:28:15,757 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_m_-459265034 spawned.
2013-10-31 20:28:15,757 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0002/attempt_20131031202710049_0002_m_000001_0. Attempting to reuse: jvm_20131031202710049_0002_m_1148474272
2013-10-31 20:28:15,758 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_m_000000_0/taskjvm.sh
2013-10-31 20:28:15,819 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_1148474272 given task: attempt_20131031202710049_0002_m_000001_0
2013-10-31 20:28:15,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:15,953 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43596, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8120752034950361120_1015, duration: 217001
2013-10-31 20:28:15,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:15,994 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39305, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 141992
2013-10-31 20:28:16,639 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_-459265034 given task: attempt_20131031202710049_0002_m_000000_0
2013-10-31 20:28:16,659 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0002_m_000002_0' to tip task_20131031202710049_0002_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:28:16,660 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0002_m_000002
2013-10-31 20:28:16,661 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0002_m_000003_0' to tip task_20131031202710049_0002_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:28:16,662 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0002_m_000003
2013-10-31 20:28:16,664 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:28:16,665 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:28:16,665 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000002_0 which needs 1 slots
2013-10-31 20:28:16,665 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0002_m_000002_0 which needs 1 slots
2013-10-31 20:28:16,665 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000003_0 which needs 1 slots
2013-10-31 20:28:16,666 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0002_m_000003_0 which needs 1 slots
2013-10-31 20:28:16,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken dst=null perm=null
2013-10-31 20:28:16,674 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39312, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3341029547036692733_1020, duration: 170634
2013-10-31 20:28:16,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml dst=null perm=null
2013-10-31 20:28:16,684 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39314, bytes: 29344, op: HDFS_READ, cliID: DFSClient_-1718064974, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1826761299642014135_1017, duration: 587166
2013-10-31 20:28:16,707 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:28:16,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar dst=null perm=null
2013-10-31 20:28:16,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33825, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1718064974, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_838393126428988157_1014, duration: 1195858
2013-10-31 20:28:16,800 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_m_167773886
2013-10-31 20:28:16,801 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_m_167773886 spawned.
2013-10-31 20:28:16,801 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_m_-612834015
2013-10-31 20:28:16,802 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_m_-612834015 spawned.
2013-10-31 20:28:16,803 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_m_000003_0/taskjvm.sh
2013-10-31 20:28:16,804 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_m_000002_0/taskjvm.sh
2013-10-31 20:28:17,223 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0002_m_000004_0' to tip task_20131031202710049_0002_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:28:17,224 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0002_m_000004
2013-10-31 20:28:17,224 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0002_m_000005_0' to tip task_20131031202710049_0002_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:28:17,224 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0002_m_000005
2013-10-31 20:28:17,225 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000004_0 task's state:UNASSIGNED
2013-10-31 20:28:17,226 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000005_0 task's state:UNASSIGNED
2013-10-31 20:28:17,226 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000004_0 which needs 1 slots
2013-10-31 20:28:17,226 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0002_m_000004_0 which needs 1 slots
2013-10-31 20:28:17,226 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000005_0 which needs 1 slots
2013-10-31 20:28:17,226 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0002_m_000005_0 which needs 1 slots
2013-10-31 20:28:17,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002/jobToken dst=null perm=null
2013-10-31 20:28:17,232 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43610, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3341029547036692733_1020, duration: 160053
2013-10-31 20:28:17,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.xml dst=null perm=null
2013-10-31 20:28:17,239 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33830, bytes: 29344, op: HDFS_READ, cliID: DFSClient_-1696781514, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1826761299642014135_1017, duration: 255709
2013-10-31 20:28:17,256 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:28:17,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.jar dst=null perm=null
2013-10-31 20:28:17,274 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43614, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1696781514, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_838393126428988157_1014, duration: 1156454
2013-10-31 20:28:17,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:17,336 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33833, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8120752034950361120_1015, duration: 218534
2013-10-31 20:28:17,352 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_m_322169434
2013-10-31 20:28:17,356 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_m_322169434 spawned.
2013-10-31 20:28:17,358 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_m_-410289417
2013-10-31 20:28:17,358 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_m_000005_0/taskjvm.sh
2013-10-31 20:28:17,360 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_m_-410289417 spawned.
2013-10-31 20:28:17,364 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_m_000004_0/taskjvm.sh
2013-10-31 20:28:17,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:17,826 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43623, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4376294229090259720_1013, duration: 175267
2013-10-31 20:28:17,895 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_-612834015 given task: attempt_20131031202710049_0002_m_000002_0
2013-10-31 20:28:17,898 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_167773886 given task: attempt_20131031202710049_0002_m_000003_0
2013-10-31 20:28:18,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:18,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:18,408 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35248, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000002_0, offset: 512, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8120752034950361120_1015, duration: 230255
2013-10-31 20:28:18,411 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43635, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000003_0, offset: 1024, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8120752034950361120_1015, duration: 270375
2013-10-31 20:28:18,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:18,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:18,452 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39345, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000003_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1710730409183361578_1012, duration: 144844
2013-10-31 20:28:18,457 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_322169434 given task: attempt_20131031202710049_0002_m_000005_0
2013-10-31 20:28:18,468 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_-410289417 given task: attempt_20131031202710049_0002_m_000004_0
2013-10-31 20:28:18,702 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35252, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000002_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 200197
2013-10-31 20:28:18,913 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 20:28:18,914 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000001_0 is done.
2013-10-31 20:28:18,915 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000001_0 was 152
2013-10-31 20:28:18,915 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:28:18,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:18,963 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43643, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000005_0, offset: 1536, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8120752034950361120_1015, duration: 214122
2013-10-31 20:28:18,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002/job.split dst=null perm=null
2013-10-31 20:28:18,974 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35259, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000004_0, offset: 1024, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8120752034950361120_1015, duration: 210873
2013-10-31 20:28:19,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:19,003 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35260, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000005_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 150507
2013-10-31 20:28:19,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:19,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:33865, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0002_m_000004_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4376294229090259720_1013, duration: 153151
2013-10-31 20:28:19,755 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_4376294229090259720_1013
2013-10-31 20:28:20,261 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 20:28:20,264 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000000_0 is done.
2013-10-31 20:28:20,264 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000000_0 was 225
2013-10-31 20:28:20,264 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:20,650 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_838393126428988157_1014
2013-10-31 20:28:20,717 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0002_m_000007_0
2013-10-31 20:28:20,717 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0002_m_000007_0
2013-10-31 20:28:20,717 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0002_m_000007_0 not found in cache
2013-10-31 20:28:21,336 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000002_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 20:28:21,338 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000002_0 is done.
2013-10-31 20:28:21,339 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000002_0 was 225
2013-10-31 20:28:21,339 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:28:21,340 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000003_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 20:28:21,342 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000003_0 is done.
2013-10-31 20:28:21,342 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000003_0 was 152
2013-10-31 20:28:21,343 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:21,722 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000000_0' has completed task_20131031202710049_0002_m_000000 successfully.
2013-10-31 20:28:21,725 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000001_0' has completed task_20131031202710049_0002_m_000001 successfully.
2013-10-31 20:28:21,727 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0002_r_000000_0' to tip task_20131031202710049_0002_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:28:21,730 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:28:21,730 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_r_000000_0 which needs 1 slots
2013-10-31 20:28:21,731 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0002_r_000000_0 which needs 1 slots
2013-10-31 20:28:21,772 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0002_r_-1524219966
2013-10-31 20:28:21,773 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0002_r_-1524219966 spawned.
2013-10-31 20:28:21,774 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0002/attempt_20131031202710049_0002_r_000000_0/taskjvm.sh
2013-10-31 20:28:21,890 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000005_0 0.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 20:28:21,894 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000005_0 is done.
2013-10-31 20:28:21,894 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000005_0 was 6
2013-10-31 20:28:21,894 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:28:21,902 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000004_0 0.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 20:28:21,904 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000004_0 is done.
2013-10-31 20:28:21,904 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000004_0 was 6
2013-10-31 20:28:21,905 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:22,673 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000002_0' has completed task_20131031202710049_0002_m_000002 successfully.
2013-10-31 20:28:22,674 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000003_0' has completed task_20131031202710049_0002_m_000003 successfully.
2013-10-31 20:28:22,947 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_r_-1524219966 given task: attempt_20131031202710049_0002_r_000000_0
2013-10-31 20:28:23,232 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000004_0' has completed task_20131031202710049_0002_m_000004 successfully.
2013-10-31 20:28:23,233 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000005_0' has completed task_20131031202710049_0002_m_000005 successfully.
2013-10-31 20:28:28,642 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52610, bytes: 225, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0002_m_000000_0, duration: 10032717
2013-10-31 20:28:28,668 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52610, bytes: 152, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0002_m_000001_0, duration: 11861605
2013-10-31 20:28:28,685 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:52985, bytes: 225, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0002_m_000002_0, duration: 12614435
2013-10-31 20:28:28,701 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:52985, bytes: 152, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0002_m_000003_0, duration: 11900416
2013-10-31 20:28:28,718 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53278, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0002_m_000004_0, duration: 13198387
2013-10-31 20:28:28,734 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53278, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0002_m_000005_0, duration: 12003392
2013-10-31 20:28:29,457 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:28:29,509 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:28:29,568 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:28:29,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:28:29,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:29,815 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0/part-00000. blk_-5235361002692776558_1021
2013-10-31 20:28:29,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5235361002692776558_1021 src: /127.0.0.1:43736 dest: /127.0.0.1:33202
2013-10-31 20:28:29,861 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5235361002692776558_1021 src: /127.0.0.1:35351 dest: /127.0.0.1:49827
2013-10-31 20:28:29,863 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5235361002692776558_1021 src: /127.0.0.1:39446 dest: /127.0.0.1:46399
2013-10-31 20:28:29,868 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39446, dest: /127.0.0.1:46399, bytes: 3640, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0002_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5235361002692776558_1021, duration: 3133572
2013-10-31 20:28:29,868 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5235361002692776558_1021 terminating
2013-10-31 20:28:29,869 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35351, dest: /127.0.0.1:49827, bytes: 3640, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0002_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5235361002692776558_1021, duration: 4619643
2013-10-31 20:28:29,869 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5235361002692776558_1021 terminating
2013-10-31 20:28:29,870 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43736, dest: /127.0.0.1:33202, bytes: 3640, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0002_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-5235361002692776558_1021, duration: 5361192
2013-10-31 20:28:29,870 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5235361002692776558_1021 terminating
2013-10-31 20:28:29,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-5235361002692776558_1021 size 3640
2013-10-31 20:28:29,871 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-5235361002692776558_1021 size 3640
2013-10-31 20:28:29,871 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5235361002692776558_1021 size 3640
2013-10-31 20:28:29,872 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0002_r_000000_0
2013-10-31 20:28:29,872 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0002_r_000000_0
2013-10-31 20:28:29,911 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0002_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:28:29,911 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:28:30,742 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031202710049_0002_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:28:30,743 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0002_r_000000_0
2013-10-31 20:28:30,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0 dst=null perm=null
2013-10-31 20:28:30,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:28:30,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:30,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary/_attempt_20131031202710049_0002_r_000000_0 dst=null perm=null
2013-10-31 20:28:32,509 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 20:28:32,512 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 20:28:32,514 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_r_000000_0 is done.
2013-10-31 20:28:32,514 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_r_000000_0 was -1
2013-10-31 20:28:32,516 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:33,747 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_r_000000_0' has completed task_20131031202710049_0002_r_000000 successfully.
2013-10-31 20:28:33,752 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0002_m_000006_0' to tip task_20131031202710049_0002_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:28:33,754 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0002_m_000006_0 task's state:UNASSIGNED
2013-10-31 20:28:33,755 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0002_m_000006_0 which needs 1 slots
2013-10-31 20:28:33,755 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0002_m_000006_0 which needs 1 slots
2013-10-31 20:28:33,795 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0002/attempt_20131031202710049_0002_m_000006_0. Attempting to reuse: jvm_20131031202710049_0002_m_1148474272
2013-10-31 20:28:34,449 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0002_m_1148474272 given task: attempt_20131031202710049_0002_m_000006_0
2013-10-31 20:28:34,534 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000006_0 0.0%
2013-10-31 20:28:34,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary dst=null perm=null
2013-10-31 20:28:34,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:34,563 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_SUCCESS from client DFSClient_attempt_20131031202710049_0002_m_000006_0
2013-10-31 20:28:34,563 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0002_m_000006_0
2013-10-31 20:28:34,573 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_838393126428988157 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:34,573 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_838393126428988157 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:34,573 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_838393126428988157 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:34,574 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_838393126428988157 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:34,574 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8120752034950361120 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:34,574 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8120752034950361120 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:34,574 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8120752034950361120 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:34,574 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8120752034950361120 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:34,575 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577477730557176247 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:34,575 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577477730557176247 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:34,575 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577477730557176247 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:34,575 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1826761299642014135 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:28:34,575 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1826761299642014135 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:34,576 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1826761299642014135 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:34,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0002 dst=null perm=null
2013-10-31 20:28:37,391 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_1826761299642014135_1017 blk_2577477730557176247_1016 blk_8120752034950361120_1015 blk_838393126428988157_1014
2013-10-31 20:28:37,392 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_1826761299642014135_1017 blk_2577477730557176247_1016 blk_8120752034950361120_1015 blk_838393126428988157_1014
2013-10-31 20:28:37,510 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0002_m_000006_0 0.0% cleanup
2013-10-31 20:28:37,512 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0002_m_000006_0 is done.
2013-10-31 20:28:37,512 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0002_m_000006_0 was -1
2013-10-31 20:28:37,512 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:38,755 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0002_r_000000_0
2013-10-31 20:28:38,755 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0002_r_000000_0
2013-10-31 20:28:38,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_838393126428988157_1014 file build/test/data/dfs/data/data2/current/blk_838393126428988157 for deletion
2013-10-31 20:28:38,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1826761299642014135_1017 file build/test/data/dfs/data/data1/current/blk_1826761299642014135 for deletion
2013-10-31 20:28:38,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_838393126428988157_1014 at file build/test/data/dfs/data/data2/current/blk_838393126428988157
2013-10-31 20:28:38,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577477730557176247_1016 file build/test/data/dfs/data/data2/current/blk_2577477730557176247 for deletion
2013-10-31 20:28:38,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1826761299642014135_1017 at file build/test/data/dfs/data/data1/current/blk_1826761299642014135
2013-10-31 20:28:38,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577477730557176247_1016 at file build/test/data/dfs/data/data2/current/blk_2577477730557176247
2013-10-31 20:28:38,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8120752034950361120_1015 file build/test/data/dfs/data/data1/current/blk_8120752034950361120 for deletion
2013-10-31 20:28:38,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8120752034950361120_1015 at file build/test/data/dfs/data/data1/current/blk_8120752034950361120
2013-10-31 20:28:39,762 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0002_m_000006_0' has completed task_20131031202710049_0002_m_000006 successfully.
2013-10-31 20:28:39,764 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0002 has completed successfully.
2013-10-31 20:28:39,764 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0002,submitTime=1383251288592,launchTime=1383251289221,firstMapTaskLaunchTime=1383251295711,firstReduceTaskLaunchTime=1383251301726,firstJobSetupTaskLaunchTime=1383251289689,firstJobCleanupTaskLaunchTime=1383251313752,finishTime=1383251319764,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=35,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D5AAB94451CA4C5A9B5B1CF6ACDB08D6/CB53F6FD13754CCFBA0B1463D4DC0A91] lower*upper/(1/1) ...platform/writablekeyvalue
2013-10-31 20:28:39,771 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_1383251288592_hadoop_%5BD5AAB94451CA4C5A9B5B1CF6ACDB08D6%2FCB53F6FD13754CCF. blk_-6360874701123200218_1022
2013-10-31 20:28:39,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6360874701123200218_1022 src: /127.0.0.1:35435 dest: /127.0.0.1:49827
2013-10-31 20:28:39,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6360874701123200218_1022 src: /127.0.0.1:34040 dest: /127.0.0.1:37249
2013-10-31 20:28:39,777 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6360874701123200218_1022 src: /127.0.0.1:39531 dest: /127.0.0.1:46399
2013-10-31 20:28:39,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39531, dest: /127.0.0.1:46399, bytes: 35021, op: HDFS_WRITE, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6360874701123200218_1022, duration: 7924669
2013-10-31 20:28:39,789 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6360874701123200218_1022 terminating
2013-10-31 20:28:39,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34040, dest: /127.0.0.1:37249, bytes: 35021, op: HDFS_WRITE, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6360874701123200218_1022, duration: 7626962
2013-10-31 20:28:39,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6360874701123200218_1022 terminating
2013-10-31 20:28:39,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35435, dest: /127.0.0.1:49827, bytes: 35021, op: HDFS_WRITE, cliID: DFSClient_-1550863639, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-6360874701123200218_1022, duration: 8650700
2013-10-31 20:28:39,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-6360874701123200218_1022 size 35021
2013-10-31 20:28:39,794 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6360874701123200218_1022 terminating
2013-10-31 20:28:39,797 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-6360874701123200218_1022 size 35021
2013-10-31 20:28:39,806 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_1383251288592_hadoop_%5BD5AAB94451CA4C5A9B5B1CF6ACDB08D6%2FCB53F6FD13754CCF from client DFSClient_-1550863639
2013-10-31 20:28:39,806 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_logs/history/job_20131031202710049_0002_1383251288592_hadoop_%5BD5AAB94451CA4C5A9B5B1CF6ACDB08D6%2FCB53F6FD13754CCF is closed by DFSClient_-1550863639
2013-10-31 20:28:39,807 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-6360874701123200218_1022 size 35021
2013-10-31 20:28:39,813 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0002_1383251288592_hadoop_%5BD5AAB94451CA4C5A9B5B1CF6ACDB08D6%2FCB53F6FD13754CCF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:28:39,816 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000000_0'
2013-10-31 20:28:39,816 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000001_0'
2013-10-31 20:28:39,816 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000006_0'
2013-10-31 20:28:39,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3341029547036692733 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:28:39,817 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000007_0'
2013-10-31 20:28:39,817 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3341029547036692733 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:28:39,817 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_r_000000_0'
2013-10-31 20:28:39,817 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3341029547036692733 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:28:39,822 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/_temporary
2013-10-31 20:28:39,824 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0002_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:28:39,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0002 dst=null perm=null
2013-10-31 20:28:39,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue dst=null perm=null
2013-10-31 20:28:39,885 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:39,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:28:39,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:28:39,892 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35439, bytes: 3672, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5235361002692776558_1021, duration: 502583
2013-10-31 20:28:39,909 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/writablekeyvalue
2013-10-31 20:28:39,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue dst=null perm=null
2013-10-31 20:28:39,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/writablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:28:39,915 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39534, bytes: 3672, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5235361002692776558_1021, duration: 500982
2013-10-31 20:28:39,927 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:28:39,928 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:28:39,964 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:28:39,964 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:28:39,965 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:28:39,965 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false"]
2013-10-31 20:28:39,966 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:28:39,967 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:28:39,967 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:28:39,968 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:28:39,977 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:28:39,977 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:28:39,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:28:39,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:28:39,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:39,997 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar. blk_6314850476091551500_1023
2013-10-31 20:28:39,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6314850476091551500_1023 src: /127.0.0.1:39535 dest: /127.0.0.1:46399
2013-10-31 20:28:40,000 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6314850476091551500_1023 src: /127.0.0.1:35442 dest: /127.0.0.1:49827
2013-10-31 20:28:40,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6314850476091551500_1023 src: /127.0.0.1:34047 dest: /127.0.0.1:37249
2013-10-31 20:28:40,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34047, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6314850476091551500_1023, duration: 9174831
2013-10-31 20:28:40,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6314850476091551500_1023 terminating
2013-10-31 20:28:40,014 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6314850476091551500_1023 size 238055
2013-10-31 20:28:40,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35442, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6314850476091551500_1023, duration: 9886754
2013-10-31 20:28:40,015 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6314850476091551500_1023 terminating
2013-10-31 20:28:40,017 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39535, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6314850476091551500_1023, duration: 10822061
2013-10-31 20:28:40,017 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6314850476091551500_1023 terminating
2013-10-31 20:28:40,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6314850476091551500_1023 size 238055
2013-10-31 20:28:40,019 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar from client DFSClient_848976415
2013-10-31 20:28:40,020 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar is closed by DFSClient_848976415
2013-10-31 20:28:40,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6314850476091551500_1023 size 238055
2013-10-31 20:28:40,027 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar. New replication is 10
2013-10-31 20:28:40,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar dst=null perm=null
2013-10-31 20:28:40,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_838393126428988157_1014 file build/test/data/dfs/data/data7/current/blk_838393126428988157 for deletion
2013-10-31 20:28:40,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1826761299642014135_1017 file build/test/data/dfs/data/data7/current/blk_1826761299642014135 for deletion
2013-10-31 20:28:40,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_838393126428988157_1014 at file build/test/data/dfs/data/data7/current/blk_838393126428988157
2013-10-31 20:28:40,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577477730557176247_1016 file build/test/data/dfs/data/data8/current/blk_2577477730557176247 for deletion
2013-10-31 20:28:40,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1826761299642014135_1017 at file build/test/data/dfs/data/data7/current/blk_1826761299642014135
2013-10-31 20:28:40,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577477730557176247_1016 at file build/test/data/dfs/data/data8/current/blk_2577477730557176247
2013-10-31 20:28:40,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8120752034950361120_1015 file build/test/data/dfs/data/data7/current/blk_8120752034950361120 for deletion
2013-10-31 20:28:40,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8120752034950361120_1015 at file build/test/data/dfs/data/data7/current/blk_8120752034950361120
2013-10-31 20:28:40,393 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37249 to replicate blk_6314850476091551500_1023 to datanode(s) 127.0.0.1:33202
2013-10-31 20:28:40,393 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_1826761299642014135_1017 blk_2577477730557176247_1016 blk_3341029547036692733_1020 blk_8120752034950361120_1015 blk_838393126428988157_1014
2013-10-31 20:28:40,393 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_3341029547036692733_1020
2013-10-31 20:28:40,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,591 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:28:40,598 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:40,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:40,603 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:28:40,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:40,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,620 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split. New replication is 10
2013-10-31 20:28:40,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split dst=null perm=null
2013-10-31 20:28:40,627 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split. blk_2105624756962547056_1024
2013-10-31 20:28:40,628 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2105624756962547056_1024 src: /127.0.0.1:34055 dest: /127.0.0.1:37249
2013-10-31 20:28:40,630 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2105624756962547056_1024 src: /127.0.0.1:35452 dest: /127.0.0.1:49827
2013-10-31 20:28:40,632 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2105624756962547056_1024 src: /127.0.0.1:43839 dest: /127.0.0.1:33202
2013-10-31 20:28:40,634 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2105624756962547056_1024 src: /127.0.0.1:39548 dest: /127.0.0.1:46399
2013-10-31 20:28:40,639 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39548, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2105624756962547056_1024, duration: 866377
2013-10-31 20:28:40,639 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2105624756962547056_1024 terminating
2013-10-31 20:28:40,640 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43839, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2105624756962547056_1024, duration: 3422882
2013-10-31 20:28:40,641 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2105624756962547056_1024 terminating
2013-10-31 20:28:40,642 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2105624756962547056_1024 size 697
2013-10-31 20:28:40,642 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35452, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2105624756962547056_1024, duration: 5260167
2013-10-31 20:28:40,643 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2105624756962547056_1024 terminating
2013-10-31 20:28:40,643 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2105624756962547056_1024 size 697
2013-10-31 20:28:40,645 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34055, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2105624756962547056_1024, duration: 7457274
2013-10-31 20:28:40,645 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2105624756962547056_1024 size 697
2013-10-31 20:28:40,645 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2105624756962547056_1024 terminating
2013-10-31 20:28:40,647 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2105624756962547056_1024 size 697
2013-10-31 20:28:40,648 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split from client DFSClient_848976415
2013-10-31 20:28:40,648 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split is closed by DFSClient_848976415
2013-10-31 20:28:40,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,676 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.splitmetainfo. blk_8368625830143675352_1025
2013-10-31 20:28:40,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8368625830143675352_1025 src: /127.0.0.1:35455 dest: /127.0.0.1:49827
2013-10-31 20:28:40,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8368625830143675352_1025 src: /127.0.0.1:34060 dest: /127.0.0.1:37249
2013-10-31 20:28:40,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8368625830143675352_1025 src: /127.0.0.1:43843 dest: /127.0.0.1:33202
2013-10-31 20:28:40,685 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43843, dest: /127.0.0.1:33202, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8368625830143675352_1025, duration: 1022637
2013-10-31 20:28:40,685 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8368625830143675352_1025 terminating
2013-10-31 20:28:40,687 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34060, dest: /127.0.0.1:37249, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8368625830143675352_1025, duration: 2636947
2013-10-31 20:28:40,687 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8368625830143675352_1025 size 78
2013-10-31 20:28:40,687 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8368625830143675352_1025 terminating
2013-10-31 20:28:40,689 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35455, dest: /127.0.0.1:49827, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8368625830143675352_1025, duration: 4658059
2013-10-31 20:28:40,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8368625830143675352_1025 terminating
2013-10-31 20:28:40,692 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8368625830143675352_1025 size 78
2013-10-31 20:28:40,692 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:28:40,693 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:28:40,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8368625830143675352_1025 size 78
2013-10-31 20:28:40,698 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000002_0'
2013-10-31 20:28:40,698 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000003_0'
2013-10-31 20:28:40,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,723 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml. blk_3029278855979255140_1026
2013-10-31 20:28:40,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3029278855979255140_1026 src: /127.0.0.1:35458 dest: /127.0.0.1:49827
2013-10-31 20:28:40,726 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3029278855979255140_1026 src: /127.0.0.1:34063 dest: /127.0.0.1:37249
2013-10-31 20:28:40,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3029278855979255140_1026 src: /127.0.0.1:43846 dest: /127.0.0.1:33202
2013-10-31 20:28:40,731 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43846, dest: /127.0.0.1:33202, bytes: 29344, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3029278855979255140_1026, duration: 1154807
2013-10-31 20:28:40,732 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3029278855979255140_1026 terminating
2013-10-31 20:28:40,733 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34063, dest: /127.0.0.1:37249, bytes: 29344, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3029278855979255140_1026, duration: 2828323
2013-10-31 20:28:40,734 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3029278855979255140_1026 terminating
2013-10-31 20:28:40,735 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35458, dest: /127.0.0.1:49827, bytes: 29344, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3029278855979255140_1026, duration: 4718886
2013-10-31 20:28:40,735 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3029278855979255140_1026 size 29344
2013-10-31 20:28:40,735 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3029278855979255140_1026 terminating
2013-10-31 20:28:40,739 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3029278855979255140_1026 size 29344
2013-10-31 20:28:40,739 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml from client DFSClient_848976415
2013-10-31 20:28:40,740 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml is closed by DFSClient_848976415
2013-10-31 20:28:40,740 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3029278855979255140_1026 size 29344
2013-10-31 20:28:40,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml dst=null perm=null
2013-10-31 20:28:40,759 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35462, bytes: 29576, op: HDFS_READ, cliID: DFSClient_899632472, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3029278855979255140_1026, duration: 506910
2013-10-31 20:28:40,783 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0003: nMaps=2 nReduces=1 max=-1
2013-10-31 20:28:40,784 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0003 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:28:40,784 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0003 RESULT=SUCCESS
2013-10-31 20:28:40,785 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0003
2013-10-31 20:28:40,785 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0003
2013-10-31 20:28:40,786 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0003
2013-10-31 20:28:40,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_1383251320747_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2FDA88B6E69942461D dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,812 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_conf.xml. blk_-5715333056314841623_1028
2013-10-31 20:28:40,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5715333056314841623_1028 src: /127.0.0.1:34067 dest: /127.0.0.1:37249
2013-10-31 20:28:40,816 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5715333056314841623_1028 src: /127.0.0.1:35464 dest: /127.0.0.1:49827
2013-10-31 20:28:40,817 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5715333056314841623_1028 src: /127.0.0.1:39559 dest: /127.0.0.1:46399
2013-10-31 20:28:40,821 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39559, dest: /127.0.0.1:46399, bytes: 29409, op: HDFS_WRITE, cliID: DFSClient_899632472, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5715333056314841623_1028, duration: 939999
2013-10-31 20:28:40,822 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5715333056314841623_1028 terminating
2013-10-31 20:28:40,823 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35464, dest: /127.0.0.1:49827, bytes: 29409, op: HDFS_WRITE, cliID: DFSClient_899632472, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5715333056314841623_1028, duration: 2223404
2013-10-31 20:28:40,823 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-5715333056314841623_1028 size 29409
2013-10-31 20:28:40,823 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5715333056314841623_1028 terminating
2013-10-31 20:28:40,825 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34067, dest: /127.0.0.1:37249, bytes: 29409, op: HDFS_WRITE, cliID: DFSClient_899632472, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-5715333056314841623_1028, duration: 3899140
2013-10-31 20:28:40,825 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5715333056314841623_1028 terminating
2013-10-31 20:28:40,827 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-5715333056314841623_1028 size 29409
2013-10-31 20:28:40,827 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_conf.xml from client DFSClient_899632472
2013-10-31 20:28:40,828 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_conf.xml is closed by DFSClient_899632472
2013-10-31 20:28:40,828 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5715333056314841623_1028 size 29409
2013-10-31 20:28:40,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:28:40,848 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken. blk_5309387503771953499_1029
2013-10-31 20:28:40,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5309387503771953499_1029 src: /127.0.0.1:39560 dest: /127.0.0.1:46399
2013-10-31 20:28:40,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5309387503771953499_1029 src: /127.0.0.1:43853 dest: /127.0.0.1:33202
2013-10-31 20:28:40,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5309387503771953499_1029 src: /127.0.0.1:34072 dest: /127.0.0.1:37249
2013-10-31 20:28:40,856 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34072, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_5309387503771953499_1029, duration: 2959017
2013-10-31 20:28:40,856 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5309387503771953499_1029 terminating
2013-10-31 20:28:40,857 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43853, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5309387503771953499_1029, duration: 3748421
2013-10-31 20:28:40,857 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5309387503771953499_1029 terminating
2013-10-31 20:28:40,857 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39560, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5309387503771953499_1029, duration: 2448969
2013-10-31 20:28:40,857 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5309387503771953499_1029 terminating
2013-10-31 20:28:40,858 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5309387503771953499_1029 size 116
2013-10-31 20:28:40,859 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken from client DFSClient_848976415
2013-10-31 20:28:40,859 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken is closed by DFSClient_848976415
2013-10-31 20:28:40,860 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_5309387503771953499_1029 size 116
2013-10-31 20:28:40,861 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5309387503771953499_1029 size 116
2013-10-31 20:28:40,865 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken
2013-10-31 20:28:40,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.splitmetainfo dst=null perm=null
2013-10-31 20:28:40,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35469, bytes: 82, op: HDFS_READ, cliID: DFSClient_899632472, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8368625830143675352_1025, duration: 147968
2013-10-31 20:28:40,869 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0003 = 38. Number of splits = 2
2013-10-31 20:28:40,869 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:40,869 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:40,870 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:40,870 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:40,870 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:40,870 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:28:40,870 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0003 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:28:40,870 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0003 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:28:41,258 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0003_m_000003_0' to tip task_20131031202710049_0003_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:28:41,264 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000004_0'
2013-10-31 20:28:41,264 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0002_m_000005_0'
2013-10-31 20:28:41,266 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0003_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:28:41,266 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0003_m_000003_0 which needs 1 slots
2013-10-31 20:28:41,266 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0003_m_000003_0 which needs 1 slots
2013-10-31 20:28:41,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken dst=null perm=null
2013-10-31 20:28:41,277 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34074, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_5309387503771953499_1029, duration: 364540
2013-10-31 20:28:41,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml dst=null perm=null
2013-10-31 20:28:41,291 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34076, bytes: 29576, op: HDFS_READ, cliID: DFSClient_-1904386128, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3029278855979255140_1026, duration: 572756
2013-10-31 20:28:41,322 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:28:41,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar dst=null perm=null
2013-10-31 20:28:41,360 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35473, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1904386128, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6314850476091551500_1023, duration: 2191904
2013-10-31 20:28:41,454 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031202710049_0002_m_322169434
2013-10-31 20:28:41,461 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25759 with signal TERM. Exit code 0
2013-10-31 20:28:41,461 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0003_m_-2121567909
2013-10-31 20:28:41,462 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0003_m_-2121567909 spawned.
2013-10-31 20:28:41,465 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0003/attempt_20131031202710049_0003_m_000003_0/taskjvm.sh
2013-10-31 20:28:41,762 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642) Starting thread to transfer block blk_6314850476091551500_1023 to 127.0.0.1:33202
2013-10-31 20:28:41,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6314850476091551500_1023 src: /127.0.0.1:43866 dest: /127.0.0.1:33202
2013-10-31 20:28:41,765 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642):Transmitted block blk_6314850476091551500_1023 to /127.0.0.1:33202
2013-10-31 20:28:41,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6314850476091551500_1023 src: /127.0.0.1:43866 dest: /127.0.0.1:33202 of size 238055
2013-10-31 20:28:41,773 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6314850476091551500_1023 size 238055
2013-10-31 20:28:41,924 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0002
2013-10-31 20:28:41,924 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0002 being deleted.
2013-10-31 20:28:42,015 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:42,015 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:42,015 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:42,015 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_m_322169434 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:42,651 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_838393126428988157_1014 file build/test/data/dfs/data/data5/current/blk_838393126428988157 for deletion
2013-10-31 20:28:42,651 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1826761299642014135_1017 file build/test/data/dfs/data/data6/current/blk_1826761299642014135 for deletion
2013-10-31 20:28:42,651 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_838393126428988157_1014 at file build/test/data/dfs/data/data5/current/blk_838393126428988157
2013-10-31 20:28:42,652 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1826761299642014135_1017 at file build/test/data/dfs/data/data6/current/blk_1826761299642014135
2013-10-31 20:28:42,652 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577477730557176247_1016 file build/test/data/dfs/data/data5/current/blk_2577477730557176247 for deletion
2013-10-31 20:28:42,652 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577477730557176247_1016 at file build/test/data/dfs/data/data5/current/blk_2577477730557176247
2013-10-31 20:28:42,652 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3341029547036692733_1020 file build/test/data/dfs/data/data6/current/blk_3341029547036692733 for deletion
2013-10-31 20:28:42,653 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3341029547036692733_1020 at file build/test/data/dfs/data/data6/current/blk_3341029547036692733
2013-10-31 20:28:42,653 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8120752034950361120_1015 file build/test/data/dfs/data/data6/current/blk_8120752034950361120 for deletion
2013-10-31 20:28:42,653 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8120752034950361120_1015 at file build/test/data/dfs/data/data6/current/blk_8120752034950361120
2013-10-31 20:28:42,816 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0003_m_-2121567909 given task: attempt_20131031202710049_0003_m_000003_0
2013-10-31 20:28:43,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3341029547036692733_1020 file build/test/data/dfs/data/data8/current/blk_3341029547036692733 for deletion
2013-10-31 20:28:43,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3341029547036692733_1020 at file build/test/data/dfs/data/data8/current/blk_3341029547036692733
2013-10-31 20:28:43,394 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_3341029547036692733_1020 blk_8120752034950361120_1015 blk_838393126428988157_1014
2013-10-31 20:28:43,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:28:44,818 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0002
2013-10-31 20:28:44,819 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0002_m_000006_0 not found in cache
2013-10-31 20:28:44,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0002 for user-log deletion with retainTimeStamp:1383337724819
2013-10-31 20:28:44,855 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0002_m_-459265034 since job job_20131031202710049_0002 is dead
2013-10-31 20:28:44,867 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25588 with signal TERM. Exit code 0
2013-10-31 20:28:45,061 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0002_r_-1524219966 since job job_20131031202710049_0002 is dead
2013-10-31 20:28:45,069 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25939 with signal TERM. Exit code 0
2013-10-31 20:28:45,091 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:45,091 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:45,091 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:45,091 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_m_-459265034 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:45,210 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_838393126428988157_1014 file build/test/data/dfs/data/data4/current/blk_838393126428988157 for deletion
2013-10-31 20:28:45,210 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3341029547036692733_1020 file build/test/data/dfs/data/data3/current/blk_3341029547036692733 for deletion
2013-10-31 20:28:45,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_838393126428988157_1014 at file build/test/data/dfs/data/data4/current/blk_838393126428988157
2013-10-31 20:28:45,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8120752034950361120_1015 file build/test/data/dfs/data/data3/current/blk_8120752034950361120 for deletion
2013-10-31 20:28:45,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3341029547036692733_1020 at file build/test/data/dfs/data/data3/current/blk_3341029547036692733
2013-10-31 20:28:45,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8120752034950361120_1015 at file build/test/data/dfs/data/data3/current/blk_8120752034950361120
2013-10-31 20:28:45,259 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:45,260 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:45,260 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:45,260 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_r_-1524219966 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:45,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0002_m_1148474272 since job job_20131031202710049_0002 is dead
2013-10-31 20:28:45,561 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25433 with signal TERM. Exit code 0
2013-10-31 20:28:45,699 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0002
2013-10-31 20:28:45,700 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0002 for user-log deletion with retainTimeStamp:1383337725700
2013-10-31 20:28:45,919 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0002_m_-612834015 since job job_20131031202710049_0002 is dead
2013-10-31 20:28:45,929 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25684 with signal TERM. Exit code 0
2013-10-31 20:28:45,930 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0002_m_167773886 since job job_20131031202710049_0002 is dead
2013-10-31 20:28:45,942 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25657 with signal TERM. Exit code 0
2013-10-31 20:28:46,149 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:46,150 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:46,150 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:46,150 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_m_-612834015 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:46,155 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:46,156 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:46,156 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:46,156 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_m_167773886 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:46,266 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0002
2013-10-31 20:28:46,267 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0002 for user-log deletion with retainTimeStamp:1383337726267
2013-10-31 20:28:46,268 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_m_000003_0 0.0% setup
2013-10-31 20:28:46,271 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0003_m_000003_0 is done.
2013-10-31 20:28:46,272 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0003_m_000003_0 was -1
2013-10-31 20:28:46,272 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:46,711 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0002_m_-410289417 since job job_20131031202710049_0002 is dead
2013-10-31 20:28:46,720 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25787 with signal TERM. Exit code 0
2013-10-31 20:28:46,726 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:46,727 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:46,727 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:46,727 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_m_1148474272 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 20:28:46,961 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:28:46,961 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:28:46,961 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:28:46,962 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0002_m_-410289417 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:28:47,274 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0003_m_000003_0' has completed task_20131031202710049_0003_m_000003 successfully.
2013-10-31 20:28:47,277 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0003_m_000000_0' to tip task_20131031202710049_0003_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:28:47,278 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0003_m_000000
2013-10-31 20:28:47,280 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0003_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:28:47,281 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0003_m_000000_0 which needs 1 slots
2013-10-31 20:28:47,281 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0003_m_000000_0 which needs 1 slots
2013-10-31 20:28:47,316 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0003_m_1333689733
2013-10-31 20:28:47,316 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0003_m_1333689733 spawned.
2013-10-31 20:28:47,319 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0003/attempt_20131031202710049_0003_m_000000_0/taskjvm.sh
2013-10-31 20:28:47,930 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0003_m_000001_0' to tip task_20131031202710049_0003_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:28:47,930 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0003_m_000001
2013-10-31 20:28:47,931 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0003_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:28:47,932 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0003_m_000001_0 which needs 1 slots
2013-10-31 20:28:47,932 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0003_m_000001_0 which needs 1 slots
2013-10-31 20:28:47,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003/jobToken dst=null perm=null
2013-10-31 20:28:47,941 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39586, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5309387503771953499_1029, duration: 165407
2013-10-31 20:28:47,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.xml dst=null perm=null
2013-10-31 20:28:47,951 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34098, bytes: 29576, op: HDFS_READ, cliID: DFSClient_-1185703457, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3029278855979255140_1026, duration: 212863
2013-10-31 20:28:47,965 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:28:47,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.jar dst=null perm=null
2013-10-31 20:28:47,982 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34099, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1185703457, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6314850476091551500_1023, duration: 1003437
2013-10-31 20:28:48,038 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0003_m_1833273752
2013-10-31 20:28:48,039 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0003_m_1833273752 spawned.
2013-10-31 20:28:48,040 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0003/attempt_20131031202710049_0003_m_000001_0/taskjvm.sh
2013-10-31 20:28:48,463 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0003_m_1333689733 given task: attempt_20131031202710049_0003_m_000000_0
2013-10-31 20:28:48,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split dst=null perm=null
2013-10-31 20:28:48,984 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34103, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0003_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2105624756962547056_1024, duration: 206158
2013-10-31 20:28:49,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:28:49,081 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0003_m_1833273752 given task: attempt_20131031202710049_0003_m_000001_0
2013-10-31 20:28:49,275 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39594, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0003_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 173135
2013-10-31 20:28:49,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003/job.split dst=null perm=null
2013-10-31 20:28:49,585 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35502, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0003_m_000001_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2105624756962547056_1024, duration: 230759
2013-10-31 20:28:49,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:28:49,885 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35503, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0003_m_000001_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 328484
2013-10-31 20:28:51,898 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:28:51,900 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0003_m_000000_0 is done.
2013-10-31 20:28:51,901 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0003_m_000000_0 was 335
2013-10-31 20:28:51,901 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:52,281 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0003_m_000003_0
2013-10-31 20:28:52,281 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0003_m_000003_0
2013-10-31 20:28:52,281 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0003_m_000003_0 not found in cache
2013-10-31 20:28:52,516 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:28:52,520 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0003_m_000001_0 is done.
2013-10-31 20:28:52,520 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0003_m_000001_0 was 335
2013-10-31 20:28:52,520 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:28:53,288 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0003_m_000000_0' has completed task_20131031202710049_0003_m_000000 successfully.
2013-10-31 20:28:53,290 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0003_r_000000_0' to tip task_20131031202710049_0003_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:28:53,292 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0003_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:28:53,293 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0003_r_000000_0 which needs 1 slots
2013-10-31 20:28:53,293 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0003_r_000000_0 which needs 1 slots
2013-10-31 20:28:53,333 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0003_r_-995358794
2013-10-31 20:28:53,334 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0003_r_-995358794 spawned.
2013-10-31 20:28:53,338 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0003/attempt_20131031202710049_0003_r_000000_0/taskjvm.sh
2013-10-31 20:28:53,937 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0003_m_000001_0' has completed task_20131031202710049_0003_m_000001 successfully.
2013-10-31 20:28:54,425 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0003_r_-995358794 given task: attempt_20131031202710049_0003_r_000000_0
2013-10-31 20:28:59,004 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 92 raw values into 1 aggregated values, total 51
2013-10-31 20:29:00,122 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53444, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0003_m_000000_0, duration: 8070008
2013-10-31 20:29:00,141 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:45175, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0003_m_000001_0, duration: 12512752
2013-10-31 20:29:00,920 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:29:00,979 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:29:01,044 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:29:01,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:01,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:01,346 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0/part-00000. blk_8694324191132864288_1030
2013-10-31 20:29:01,369 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8694324191132864288_1030 src: /127.0.0.1:35510 dest: /127.0.0.1:49827
2013-10-31 20:29:01,371 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8694324191132864288_1030 src: /127.0.0.1:39605 dest: /127.0.0.1:46399
2013-10-31 20:29:01,372 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8694324191132864288_1030 src: /127.0.0.1:43898 dest: /127.0.0.1:33202
2013-10-31 20:29:01,385 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43898, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0003_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8694324191132864288_1030, duration: 1431682
2013-10-31 20:29:01,385 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8694324191132864288_1030 terminating
2013-10-31 20:29:01,390 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39605, dest: /127.0.0.1:46399, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0003_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8694324191132864288_1030, duration: 3700392
2013-10-31 20:29:01,392 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8694324191132864288_1030 terminating
2013-10-31 20:29:01,393 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8694324191132864288_1030 size 708
2013-10-31 20:29:01,393 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35510, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0003_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8694324191132864288_1030, duration: 10117530
2013-10-31 20:29:01,394 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_8694324191132864288_1030 size 708
2013-10-31 20:29:01,394 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8694324191132864288_1030 terminating
2013-10-31 20:29:01,395 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8694324191132864288_1030 size 708
2013-10-31 20:29:01,396 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0003_r_000000_0
2013-10-31 20:29:01,397 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0003_r_000000_0
2013-10-31 20:29:01,432 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0003_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:29:01,433 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:29:02,302 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0003_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:55898
2013-10-31 20:29:02,304 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0003_r_000000_0
2013-10-31 20:29:02,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0 dst=null perm=null
2013-10-31 20:29:02,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:02,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:02,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary/_attempt_20131031202710049_0003_r_000000_0 dst=null perm=null
2013-10-31 20:29:03,971 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 20:29:03,974 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 20:29:03,976 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0003_r_000000_0 is done.
2013-10-31 20:29:03,976 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0003_r_000000_0 was -1
2013-10-31 20:29:03,977 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:05,308 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0003_r_000000_0' has completed task_20131031202710049_0003_r_000000 successfully.
2013-10-31 20:29:05,313 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0003_m_000002_0' to tip task_20131031202710049_0003_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:29:05,315 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0003_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:29:05,316 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0003_m_000002_0 which needs 1 slots
2013-10-31 20:29:05,316 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0003_m_000002_0 which needs 1 slots
2013-10-31 20:29:05,354 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0003/attempt_20131031202710049_0003_m_000002_0. Attempting to reuse: jvm_20131031202710049_0003_m_1333689733
2013-10-31 20:29:05,976 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0003_m_1333689733 given task: attempt_20131031202710049_0003_m_000002_0
2013-10-31 20:29:06,113 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_m_000002_0 0.0%
2013-10-31 20:29:06,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_temporary dst=null perm=null
2013-10-31 20:29:06,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:06,131 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_SUCCESS from client DFSClient_attempt_20131031202710049_0003_m_000002_0
2013-10-31 20:29:06,131 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0003_m_000002_0
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6314850476091551500 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6314850476091551500 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6314850476091551500 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6314850476091551500 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2105624756962547056 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2105624756962547056 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2105624756962547056 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:06,136 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2105624756962547056 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:06,137 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8368625830143675352 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:06,137 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8368625830143675352 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:06,137 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8368625830143675352 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:06,137 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3029278855979255140 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:06,137 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3029278855979255140 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:06,137 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3029278855979255140 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:06,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0003 dst=null perm=null
2013-10-31 20:29:07,049 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-6360874701123200218_1022
2013-10-31 20:29:07,398 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_6314850476091551500_1023 blk_2105624756962547056_1024
2013-10-31 20:29:07,398 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_8368625830143675352_1025 blk_3029278855979255140_1026 blk_6314850476091551500_1023 blk_2105624756962547056_1024
2013-10-31 20:29:08,052 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:29:08,068 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:29:08,074 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:29:08,080 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:29:08,086 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:29:08,092 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:29:08,097 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:29:08,097 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:29:09,063 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0003_m_000002_0 0.0% cleanup
2013-10-31 20:29:09,065 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0003_m_000002_0 is done.
2013-10-31 20:29:09,065 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0003_m_000002_0 was -1
2013-10-31 20:29:09,066 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:09,660 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2105624756962547056_1024 file build/test/data/dfs/data/data6/current/blk_2105624756962547056 for deletion
2013-10-31 20:29:09,660 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6314850476091551500_1023 file build/test/data/dfs/data/data5/current/blk_6314850476091551500 for deletion
2013-10-31 20:29:09,661 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2105624756962547056_1024 at file build/test/data/dfs/data/data6/current/blk_2105624756962547056
2013-10-31 20:29:09,661 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6314850476091551500_1023 at file build/test/data/dfs/data/data5/current/blk_6314850476091551500
2013-10-31 20:29:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2105624756962547056_1024 file build/test/data/dfs/data/data7/current/blk_2105624756962547056 for deletion
2013-10-31 20:29:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3029278855979255140_1026 file build/test/data/dfs/data/data7/current/blk_3029278855979255140 for deletion
2013-10-31 20:29:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2105624756962547056_1024 at file build/test/data/dfs/data/data7/current/blk_2105624756962547056
2013-10-31 20:29:10,045 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6314850476091551500_1023 file build/test/data/dfs/data/data8/current/blk_6314850476091551500 for deletion
2013-10-31 20:29:10,045 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3029278855979255140_1026 at file build/test/data/dfs/data/data7/current/blk_3029278855979255140
2013-10-31 20:29:10,045 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8368625830143675352_1025 file build/test/data/dfs/data/data8/current/blk_8368625830143675352 for deletion
2013-10-31 20:29:10,045 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6314850476091551500_1023 at file build/test/data/dfs/data/data8/current/blk_6314850476091551500
2013-10-31 20:29:10,046 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8368625830143675352_1025 at file build/test/data/dfs/data/data8/current/blk_8368625830143675352
2013-10-31 20:29:10,316 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0003_r_000000_0
2013-10-31 20:29:10,316 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0003_r_000000_0
2013-10-31 20:29:10,399 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_8368625830143675352_1025 blk_3029278855979255140_1026 blk_6314850476091551500_1023 blk_2105624756962547056_1024
2013-10-31 20:29:10,399 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_8368625830143675352_1025 blk_3029278855979255140_1026 blk_6314850476091551500_1023 blk_2105624756962547056_1024
2013-10-31 20:29:11,324 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0003_m_000002_0' has completed task_20131031202710049_0003_m_000002 successfully.
2013-10-31 20:29:11,325 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0003 has completed successfully.
2013-10-31 20:29:11,326 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0003,submitTime=1383251320747,launchTime=1383251320870,firstMapTaskLaunchTime=1383251327277,firstReduceTaskLaunchTime=1383251333290,firstJobSetupTaskLaunchTime=1383251321258,firstJobCleanupTaskLaunchTime=1383251345313,finishTime=1383251351325,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=17,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D88A272C6D674CC7B97262331F6897D9/DA88B6E69942461DBAFEF98C19EB0200] lower*upper/(1/2)
2013-10-31 20:29:11,334 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_1383251320747_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2FDA88B6E69942461D. blk_-8350257418098389693_1031
2013-10-31 20:29:11,336 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8350257418098389693_1031 src: /127.0.0.1:34119 dest: /127.0.0.1:37249
2013-10-31 20:29:11,338 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8350257418098389693_1031 src: /127.0.0.1:43902 dest: /127.0.0.1:33202
2013-10-31 20:29:11,340 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8350257418098389693_1031 src: /127.0.0.1:35517 dest: /127.0.0.1:49827
2013-10-31 20:29:11,343 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35517, dest: /127.0.0.1:49827, bytes: 20684, op: HDFS_WRITE, cliID: DFSClient_899632472, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8350257418098389693_1031, duration: 928668
2013-10-31 20:29:11,344 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8350257418098389693_1031 terminating
2013-10-31 20:29:11,345 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43902, dest: /127.0.0.1:33202, bytes: 20684, op: HDFS_WRITE, cliID: DFSClient_899632472, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8350257418098389693_1031, duration: 2387363
2013-10-31 20:29:11,345 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8350257418098389693_1031 terminating
2013-10-31 20:29:11,347 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34119, dest: /127.0.0.1:37249, bytes: 20684, op: HDFS_WRITE, cliID: DFSClient_899632472, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8350257418098389693_1031, duration: 4337047
2013-10-31 20:29:11,347 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8350257418098389693_1031 size 20684
2013-10-31 20:29:11,347 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8350257418098389693_1031 terminating
2013-10-31 20:29:11,350 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8350257418098389693_1031 size 20684
2013-10-31 20:29:11,351 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_1383251320747_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2FDA88B6E69942461D from client DFSClient_899632472
2013-10-31 20:29:11,351 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/_logs/history/job_20131031202710049_0003_1383251320747_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2FDA88B6E69942461D is closed by DFSClient_899632472
2013-10-31 20:29:11,351 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 171 Total time for transactions(ms): 7Number of transactions batched in Syncs: 6 Number of syncs: 109 SyncTimes(ms): 2864 520
2013-10-31 20:29:11,351 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8350257418098389693_1031 size 20684
2013-10-31 20:29:11,365 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0003_1383251320747_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2FDA88B6E69942461D to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:29:11,369 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0003_m_000000_0'
2013-10-31 20:29:11,369 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0003_m_000002_0'
2013-10-31 20:29:11,370 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0003_m_000003_0'
2013-10-31 20:29:11,371 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0003_r_000000_0'
2013-10-31 20:29:11,371 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5309387503771953499 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:11,371 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5309387503771953499 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:11,371 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5309387503771953499 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:11,377 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...ue/true/false/false/false
2013-10-31 20:29:11,378 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0003_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:29:11,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0003 dst=null perm=null
2013-10-31 20:29:11,385 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:29:11,385 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:29:11,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:11,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:29:11,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:11,420 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar. blk_7549334751741244840_1032
2013-10-31 20:29:11,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7549334751741244840_1032 src: /127.0.0.1:39613 dest: /127.0.0.1:46399
2013-10-31 20:29:11,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7549334751741244840_1032 src: /127.0.0.1:43906 dest: /127.0.0.1:33202
2013-10-31 20:29:11,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7549334751741244840_1032 src: /127.0.0.1:34125 dest: /127.0.0.1:37249
2013-10-31 20:29:11,437 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34125, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7549334751741244840_1032, duration: 9069333
2013-10-31 20:29:11,438 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7549334751741244840_1032 terminating
2013-10-31 20:29:11,439 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43906, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7549334751741244840_1032, duration: 10604077
2013-10-31 20:29:11,439 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7549334751741244840_1032 terminating
2013-10-31 20:29:11,440 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39613, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7549334751741244840_1032, duration: 12174001
2013-10-31 20:29:11,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7549334751741244840_1032 size 238055
2013-10-31 20:29:11,441 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7549334751741244840_1032 terminating
2013-10-31 20:29:11,443 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7549334751741244840_1032 size 238055
2013-10-31 20:29:11,443 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar from client DFSClient_848976415
2013-10-31 20:29:11,444 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar is closed by DFSClient_848976415
2013-10-31 20:29:11,444 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7549334751741244840_1032 size 238055
2013-10-31 20:29:11,450 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar. New replication is 10
2013-10-31 20:29:11,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar dst=null perm=null
2013-10-31 20:29:11,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:11,464 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:29:11,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C dst=null perm=null
2013-10-31 20:29:11,471 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:11,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/part-00000 dst=null perm=null
2013-10-31 20:29:11,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:11,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:11,490 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split. New replication is 10
2013-10-31 20:29:11,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split dst=null perm=null
2013-10-31 20:29:11,497 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split. blk_879783227615782819_1033
2013-10-31 20:29:11,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_879783227615782819_1033 src: /127.0.0.1:34126 dest: /127.0.0.1:37249
2013-10-31 20:29:11,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_879783227615782819_1033 src: /127.0.0.1:39617 dest: /127.0.0.1:46399
2013-10-31 20:29:11,503 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_879783227615782819_1033 src: /127.0.0.1:35524 dest: /127.0.0.1:49827
2013-10-31 20:29:11,504 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_879783227615782819_1033 src: /127.0.0.1:43911 dest: /127.0.0.1:33202
2013-10-31 20:29:11,508 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43911, dest: /127.0.0.1:33202, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_879783227615782819_1033, duration: 2518137
2013-10-31 20:29:11,509 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_879783227615782819_1033 terminating
2013-10-31 20:29:11,510 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35524, dest: /127.0.0.1:49827, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_879783227615782819_1033, duration: 2811612
2013-10-31 20:29:11,510 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_879783227615782819_1033 terminating
2013-10-31 20:29:11,512 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39617, dest: /127.0.0.1:46399, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_879783227615782819_1033, duration: 4435824
2013-10-31 20:29:11,512 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_879783227615782819_1033 terminating
2013-10-31 20:29:11,514 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34126, dest: /127.0.0.1:37249, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_879783227615782819_1033, duration: 6313939
2013-10-31 20:29:11,514 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_879783227615782819_1033 size 357
2013-10-31 20:29:11,514 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_879783227615782819_1033 terminating
2013-10-31 20:29:11,517 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_879783227615782819_1033 size 357
2013-10-31 20:29:11,517 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_879783227615782819_1033 size 357
2013-10-31 20:29:11,518 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split from client DFSClient_848976415
2013-10-31 20:29:11,518 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split is closed by DFSClient_848976415
2013-10-31 20:29:11,519 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_879783227615782819_1033 size 357
2013-10-31 20:29:11,772 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2105624756962547056_1024 file build/test/data/dfs/data/data1/current/blk_2105624756962547056 for deletion
2013-10-31 20:29:11,772 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3029278855979255140_1026 file build/test/data/dfs/data/data1/current/blk_3029278855979255140 for deletion
2013-10-31 20:29:11,772 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2105624756962547056_1024 at file build/test/data/dfs/data/data1/current/blk_2105624756962547056
2013-10-31 20:29:11,773 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6314850476091551500_1023 file build/test/data/dfs/data/data2/current/blk_6314850476091551500 for deletion
2013-10-31 20:29:11,773 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3029278855979255140_1026 at file build/test/data/dfs/data/data1/current/blk_3029278855979255140
2013-10-31 20:29:11,773 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8368625830143675352_1025 file build/test/data/dfs/data/data2/current/blk_8368625830143675352 for deletion
2013-10-31 20:29:11,773 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6314850476091551500_1023 at file build/test/data/dfs/data/data2/current/blk_6314850476091551500
2013-10-31 20:29:11,774 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8368625830143675352_1025 at file build/test/data/dfs/data/data2/current/blk_8368625830143675352
2013-10-31 20:29:11,959 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0003_m_000001_0'
2013-10-31 20:29:12,219 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2105624756962547056_1024 file build/test/data/dfs/data/data3/current/blk_2105624756962547056 for deletion
2013-10-31 20:29:12,219 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3029278855979255140_1026 file build/test/data/dfs/data/data3/current/blk_3029278855979255140 for deletion
2013-10-31 20:29:12,219 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2105624756962547056_1024 at file build/test/data/dfs/data/data3/current/blk_2105624756962547056
2013-10-31 20:29:12,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6314850476091551500_1023 file build/test/data/dfs/data/data3/current/blk_6314850476091551500 for deletion
2013-10-31 20:29:12,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3029278855979255140_1026 at file build/test/data/dfs/data/data3/current/blk_3029278855979255140
2013-10-31 20:29:12,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8368625830143675352_1025 file build/test/data/dfs/data/data4/current/blk_8368625830143675352 for deletion
2013-10-31 20:29:12,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6314850476091551500_1023 at file build/test/data/dfs/data/data3/current/blk_6314850476091551500
2013-10-31 20:29:12,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8368625830143675352_1025 at file build/test/data/dfs/data/data4/current/blk_8368625830143675352
2013-10-31 20:29:12,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,391 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.splitmetainfo. blk_-4235591451611549021_1034
2013-10-31 20:29:12,392 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235591451611549021_1034 src: /127.0.0.1:39620 dest: /127.0.0.1:46399
2013-10-31 20:29:12,394 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235591451611549021_1034 src: /127.0.0.1:43913 dest: /127.0.0.1:33202
2013-10-31 20:29:12,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235591451611549021_1034 src: /127.0.0.1:34132 dest: /127.0.0.1:37249
2013-10-31 20:29:12,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34132, dest: /127.0.0.1:37249, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4235591451611549021_1034, duration: 929116
2013-10-31 20:29:12,402 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4235591451611549021_1034 terminating
2013-10-31 20:29:12,403 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43913, dest: /127.0.0.1:33202, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4235591451611549021_1034, duration: 4038574
2013-10-31 20:29:12,403 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4235591451611549021_1034 terminating
2013-10-31 20:29:12,404 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39620, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4235591451611549021_1034, duration: 5827556
2013-10-31 20:29:12,405 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4235591451611549021_1034 terminating
2013-10-31 20:29:12,408 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4235591451611549021_1034 size 45
2013-10-31 20:29:12,409 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:29:12,409 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:29:12,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4235591451611549021_1034 size 45
2013-10-31 20:29:12,410 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4235591451611549021_1034 size 45
2013-10-31 20:29:12,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,486 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml. blk_-5005083787941543205_1035
2013-10-31 20:29:12,488 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5005083787941543205_1035 src: /127.0.0.1:39623 dest: /127.0.0.1:46399
2013-10-31 20:29:12,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5005083787941543205_1035 src: /127.0.0.1:35530 dest: /127.0.0.1:49827
2013-10-31 20:29:12,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5005083787941543205_1035 src: /127.0.0.1:43917 dest: /127.0.0.1:33202
2013-10-31 20:29:12,493 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43917, dest: /127.0.0.1:33202, bytes: 28517, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-5005083787941543205_1035, duration: 1604394
2013-10-31 20:29:12,493 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5005083787941543205_1035 terminating
2013-10-31 20:29:12,494 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35530, dest: /127.0.0.1:49827, bytes: 28517, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5005083787941543205_1035, duration: 2402285
2013-10-31 20:29:12,494 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5005083787941543205_1035 terminating
2013-10-31 20:29:12,494 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39623, dest: /127.0.0.1:46399, bytes: 28517, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5005083787941543205_1035, duration: 3163745
2013-10-31 20:29:12,495 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5005083787941543205_1035 terminating
2013-10-31 20:29:12,496 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-5005083787941543205_1035 size 28517
2013-10-31 20:29:12,496 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml from client DFSClient_848976415
2013-10-31 20:29:12,496 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml is closed by DFSClient_848976415
2013-10-31 20:29:12,497 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5005083787941543205_1035 size 28517
2013-10-31 20:29:12,499 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-5005083787941543205_1035 size 28517
2013-10-31 20:29:12,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml dst=null perm=null
2013-10-31 20:29:12,508 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43919, bytes: 28741, op: HDFS_READ, cliID: DFSClient_1271040249, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-5005083787941543205_1035, duration: 212127
2013-10-31 20:29:12,528 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0004: nMaps=1 nReduces=1 max=-1
2013-10-31 20:29:12,529 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0004 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:29:12,529 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0004 RESULT=SUCCESS
2013-10-31 20:29:12,529 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0004
2013-10-31 20:29:12,530 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0004
2013-10-31 20:29:12,530 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0004
2013-10-31 20:29:12,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_1383251352502_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2F430B5825EF1441D3 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,566 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_conf.xml. blk_5471784388218150662_1037
2013-10-31 20:29:12,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5471784388218150662_1037 src: /127.0.0.1:43920 dest: /127.0.0.1:33202
2013-10-31 20:29:12,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5471784388218150662_1037 src: /127.0.0.1:39629 dest: /127.0.0.1:46399
2013-10-31 20:29:12,571 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5471784388218150662_1037 src: /127.0.0.1:35536 dest: /127.0.0.1:49827
2013-10-31 20:29:12,576 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35536, dest: /127.0.0.1:49827, bytes: 28582, op: HDFS_WRITE, cliID: DFSClient_1271040249, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_5471784388218150662_1037, duration: 1151533
2013-10-31 20:29:12,576 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5471784388218150662_1037 terminating
2013-10-31 20:29:12,577 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_5471784388218150662_1037 size 28582
2013-10-31 20:29:12,578 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39629, dest: /127.0.0.1:46399, bytes: 28582, op: HDFS_WRITE, cliID: DFSClient_1271040249, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5471784388218150662_1037, duration: 2945253
2013-10-31 20:29:12,578 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5471784388218150662_1037 terminating
2013-10-31 20:29:12,579 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5471784388218150662_1037 size 28582
2013-10-31 20:29:12,580 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43920, dest: /127.0.0.1:33202, bytes: 28582, op: HDFS_WRITE, cliID: DFSClient_1271040249, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5471784388218150662_1037, duration: 4848990
2013-10-31 20:29:12,580 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5471784388218150662_1037 terminating
2013-10-31 20:29:12,584 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5471784388218150662_1037 size 28582
2013-10-31 20:29:12,585 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_conf.xml from client DFSClient_1271040249
2013-10-31 20:29:12,585 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_conf.xml is closed by DFSClient_1271040249
2013-10-31 20:29:12,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:12,600 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004/jobToken. blk_1785864765006837424_1038
2013-10-31 20:29:12,602 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1785864765006837424_1038 src: /127.0.0.1:43923 dest: /127.0.0.1:33202
2013-10-31 20:29:12,604 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1785864765006837424_1038 src: /127.0.0.1:34142 dest: /127.0.0.1:37249
2013-10-31 20:29:12,605 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1785864765006837424_1038 src: /127.0.0.1:39633 dest: /127.0.0.1:46399
2013-10-31 20:29:12,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39633, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1785864765006837424_1038, duration: 2156313
2013-10-31 20:29:12,611 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1785864765006837424_1038 terminating
2013-10-31 20:29:12,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34142, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1785864765006837424_1038, duration: 3009997
2013-10-31 20:29:12,612 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1785864765006837424_1038 terminating
2013-10-31 20:29:12,613 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43923, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1785864765006837424_1038, duration: 4018487
2013-10-31 20:29:12,613 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1785864765006837424_1038 terminating
2013-10-31 20:29:12,613 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_1785864765006837424_1038 size 116
2013-10-31 20:29:12,615 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004/jobToken from client DFSClient_848976415
2013-10-31 20:29:12,616 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004/jobToken is closed by DFSClient_848976415
2013-10-31 20:29:12,616 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_1785864765006837424_1038 size 116
2013-10-31 20:29:12,616 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_1785864765006837424_1038 size 116
2013-10-31 20:29:12,621 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004/jobToken
2013-10-31 20:29:12,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.splitmetainfo dst=null perm=null
2013-10-31 20:29:12,626 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39634, bytes: 49, op: HDFS_READ, cliID: DFSClient_1271040249, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4235591451611549021_1034, duration: 337502
2013-10-31 20:29:12,627 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0004 = 708. Number of splits = 1
2013-10-31 20:29:12,627 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:12,627 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:12,628 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:12,628 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0004 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:29:12,628 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0004 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:29:12,855 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0004_m_000002_0' to tip task_20131031202710049_0004_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:29:12,862 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0004_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:29:12,863 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0004_m_000002_0 which needs 1 slots
2013-10-31 20:29:12,863 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0003
2013-10-31 20:29:12,863 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0004_m_000002_0 which needs 1 slots
2013-10-31 20:29:12,863 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0003 being deleted.
2013-10-31 20:29:12,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004/jobToken dst=null perm=null
2013-10-31 20:29:12,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39635, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1785864765006837424_1038, duration: 327846
2013-10-31 20:29:12,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.xml dst=null perm=null
2013-10-31 20:29:12,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35543, bytes: 28741, op: HDFS_READ, cliID: DFSClient_1830490903, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5005083787941543205_1035, duration: 500224
2013-10-31 20:29:12,920 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:29:12,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.jar dst=null perm=null
2013-10-31 20:29:12,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34148, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1830490903, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7549334751741244840_1032, duration: 1921913
2013-10-31 20:29:13,058 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0004_m_-781670435
2013-10-31 20:29:13,059 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0004_m_-781670435 spawned.
2013-10-31 20:29:13,060 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0004/attempt_20131031202710049_0004_m_000002_0/taskjvm.sh
2013-10-31 20:29:13,400 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:33202 to replicate blk_7549334751741244840_1032 to datanode(s) 127.0.0.1:49827
2013-10-31 20:29:13,400 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_5309387503771953499_1029
2013-10-31 20:29:13,400 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_5309387503771953499_1029
2013-10-31 20:29:13,737 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0003
2013-10-31 20:29:13,738 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0003 being deleted.
2013-10-31 20:29:14,772 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5309387503771953499_1029 file build/test/data/dfs/data/data1/current/blk_5309387503771953499 for deletion
2013-10-31 20:29:14,773 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5309387503771953499_1029 at file build/test/data/dfs/data/data1/current/blk_5309387503771953499
2013-10-31 20:29:14,889 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0004_m_-781670435 given task: attempt_20131031202710049_0004_m_000002_0
2013-10-31 20:29:15,219 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909) Starting thread to transfer block blk_7549334751741244840_1032 to 127.0.0.1:49827
2013-10-31 20:29:15,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5309387503771953499_1029 file build/test/data/dfs/data/data4/current/blk_5309387503771953499 for deletion
2013-10-31 20:29:15,220 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5309387503771953499_1029 at file build/test/data/dfs/data/data4/current/blk_5309387503771953499
2013-10-31 20:29:15,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7549334751741244840_1032 src: /127.0.0.1:35546 dest: /127.0.0.1:49827
2013-10-31 20:29:15,221 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909):Transmitted block blk_7549334751741244840_1032 to /127.0.0.1:49827
2013-10-31 20:29:15,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7549334751741244840_1032 src: /127.0.0.1:35546 dest: /127.0.0.1:49827 of size 238055
2013-10-31 20:29:15,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7549334751741244840_1032 size 238055
2013-10-31 20:29:15,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:16,372 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0003
2013-10-31 20:29:16,372 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0003_m_000002_0 not found in cache
2013-10-31 20:29:16,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0003 for user-log deletion with retainTimeStamp:1383337756373
2013-10-31 20:29:16,401 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_5309387503771953499_1029
2013-10-31 20:29:16,516 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0003_r_-995358794 since job job_20131031202710049_0003 is dead
2013-10-31 20:29:16,525 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26504 with signal TERM. Exit code 0
2013-10-31 20:29:16,684 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:16,685 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:16,685 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:16,685 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0003_r_-995358794 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:29:16,960 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0003
2013-10-31 20:29:16,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0003 for user-log deletion with retainTimeStamp:1383337756961
2013-10-31 20:29:17,104 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0003_m_1333689733 since job job_20131031202710049_0003 is dead
2013-10-31 20:29:17,110 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0003_m_1833273752 since job job_20131031202710049_0003 is dead
2013-10-31 20:29:17,115 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26353 with signal TERM. Exit code 0
2013-10-31 20:29:17,120 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26407 with signal TERM. Exit code 0
2013-10-31 20:29:17,196 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0003_m_-2121567909 since job job_20131031202710049_0003 is dead
2013-10-31 20:29:17,200 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26167 with signal TERM. Exit code 0
2013-10-31 20:29:17,280 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:17,280 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:17,280 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:17,280 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0003_m_1333689733 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:29:17,321 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:17,321 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:17,321 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:17,321 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0003_m_1833273752 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:29:17,377 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:17,378 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:17,378 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:17,378 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0003_m_-2121567909 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:29:18,343 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_m_000002_0 0.0% setup
2013-10-31 20:29:18,346 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0004_m_000002_0 is done.
2013-10-31 20:29:18,346 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0004_m_000002_0 was -1
2013-10-31 20:29:18,346 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:18,663 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5309387503771953499_1029 file build/test/data/dfs/data/data6/current/blk_5309387503771953499 for deletion
2013-10-31 20:29:18,663 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5309387503771953499_1029 at file build/test/data/dfs/data/data6/current/blk_5309387503771953499
2013-10-31 20:29:18,869 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0004_m_000002_0' has completed task_20131031202710049_0004_m_000002 successfully.
2013-10-31 20:29:18,872 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0004_m_000000_0' to tip task_20131031202710049_0004_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:29:18,873 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0004_m_000000
2013-10-31 20:29:18,876 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0004_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:29:18,877 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0004_m_000000_0 which needs 1 slots
2013-10-31 20:29:18,877 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0004_m_000000_0 which needs 1 slots
2013-10-31 20:29:18,915 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0004_m_3239044
2013-10-31 20:29:18,916 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0004_m_3239044 spawned.
2013-10-31 20:29:18,920 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0004/attempt_20131031202710049_0004_m_000000_0/taskjvm.sh
2013-10-31 20:29:19,901 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0004_m_3239044 given task: attempt_20131031202710049_0004_m_000000_0
2013-10-31 20:29:20,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004/job.split dst=null perm=null
2013-10-31 20:29:20,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39644, bytes: 361, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0004_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_879783227615782819_1033, duration: 212690
2013-10-31 20:29:20,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/part-00000 dst=null perm=null
2013-10-31 20:29:20,479 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:43937, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0004_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8694324191132864288_1030, duration: 482000
2013-10-31 20:29:23,371 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C/part-00000:0+708
2013-10-31 20:29:23,375 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0004_m_000000_0 is done.
2013-10-31 20:29:23,376 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0004_m_000000_0 was 619
2013-10-31 20:29:23,376 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:23,877 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0004_m_000002_0
2013-10-31 20:29:23,877 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0004_m_000002_0
2013-10-31 20:29:23,877 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0004_m_000002_0 not found in cache
2013-10-31 20:29:24,882 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0004_m_000000_0' has completed task_20131031202710049_0004_m_000000 successfully.
2013-10-31 20:29:24,884 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0004_r_000000_0' to tip task_20131031202710049_0004_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:29:24,886 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0004_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:29:24,887 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0004_r_000000_0 which needs 1 slots
2013-10-31 20:29:24,887 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0004_r_000000_0 which needs 1 slots
2013-10-31 20:29:24,918 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0004_r_1148474272
2013-10-31 20:29:24,919 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0004_r_1148474272 spawned.
2013-10-31 20:29:24,923 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0004/attempt_20131031202710049_0004_r_000000_0/taskjvm.sh
2013-10-31 20:29:25,737 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0004_r_1148474272 given task: attempt_20131031202710049_0004_r_000000_0
2013-10-31 20:29:31,442 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52825, bytes: 619, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0004_m_000000_0, duration: 6009700
2013-10-31 20:29:32,240 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:29:32,316 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:29:32,369 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:29:32,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:32,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:32,609 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0/part-00000. blk_-3218731179532037440_1039
2013-10-31 20:29:32,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3218731179532037440_1039 src: /127.0.0.1:34160 dest: /127.0.0.1:37249
2013-10-31 20:29:32,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3218731179532037440_1039 src: /127.0.0.1:39651 dest: /127.0.0.1:46399
2013-10-31 20:29:32,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3218731179532037440_1039 src: /127.0.0.1:43944 dest: /127.0.0.1:33202
2013-10-31 20:29:32,665 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43944, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0004_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3218731179532037440_1039, duration: 2214480
2013-10-31 20:29:32,665 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3218731179532037440_1039 terminating
2013-10-31 20:29:32,666 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39651, dest: /127.0.0.1:46399, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0004_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3218731179532037440_1039, duration: 3412760
2013-10-31 20:29:32,666 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3218731179532037440_1039 terminating
2013-10-31 20:29:32,666 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34160, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0004_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3218731179532037440_1039, duration: 4179971
2013-10-31 20:29:32,667 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3218731179532037440_1039 terminating
2013-10-31 20:29:32,669 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-3218731179532037440_1039 size 708
2013-10-31 20:29:32,670 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3218731179532037440_1039 size 708
2013-10-31 20:29:32,670 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3218731179532037440_1039 size 708
2013-10-31 20:29:32,670 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0004_r_000000_0
2013-10-31 20:29:32,670 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0004_r_000000_0
2013-10-31 20:29:32,710 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0004_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:29:32,710 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:29:33,898 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0004_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:29:33,899 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0004_r_000000_0
2013-10-31 20:29:34,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0 dst=null perm=null
2013-10-31 20:29:34,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:34,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:34,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary/_attempt_20131031202710049_0004_r_000000_0 dst=null perm=null
2013-10-31 20:29:35,290 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 20:29:35,292 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 20:29:35,293 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0004_r_000000_0 is done.
2013-10-31 20:29:35,293 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0004_r_000000_0 was -1
2013-10-31 20:29:35,293 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:36,903 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0004_r_000000_0' has completed task_20131031202710049_0004_r_000000 successfully.
2013-10-31 20:29:36,907 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0004_m_000001_0' to tip task_20131031202710049_0004_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:29:36,909 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0004_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:29:36,909 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0004_m_000001_0 which needs 1 slots
2013-10-31 20:29:36,909 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0004_m_000001_0 which needs 1 slots
2013-10-31 20:29:36,939 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0004/attempt_20131031202710049_0004_m_000001_0. Attempting to reuse: jvm_20131031202710049_0004_m_-781670435
2013-10-31 20:29:38,428 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0004_m_-781670435 given task: attempt_20131031202710049_0004_m_000001_0
2013-10-31 20:29:38,533 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_m_000001_0 0.0%
2013-10-31 20:29:38,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary dst=null perm=null
2013-10-31 20:29:38,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:38,558 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_SUCCESS from client DFSClient_attempt_20131031202710049_0004_m_000001_0
2013-10-31 20:29:38,558 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0004_m_000001_0
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7549334751741244840 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7549334751741244840 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7549334751741244840 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7549334751741244840 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_879783227615782819 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_879783227615782819 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:38,563 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_879783227615782819 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_879783227615782819 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4235591451611549021 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4235591451611549021 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4235591451611549021 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5005083787941543205 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5005083787941543205 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:38,564 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5005083787941543205 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:38,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0004 dst=null perm=null
2013-10-31 20:29:40,405 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_879783227615782819_1033 blk_7549334751741244840_1032 blk_-4235591451611549021_1034 blk_-5005083787941543205_1035
2013-10-31 20:29:40,405 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_879783227615782819_1033 blk_7549334751741244840_1032 blk_-4235591451611549021_1034
2013-10-31 20:29:41,506 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0004_m_000001_0 0.0% cleanup
2013-10-31 20:29:41,508 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0004_m_000001_0 is done.
2013-10-31 20:29:41,508 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0004_m_000001_0 was -1
2013-10-31 20:29:41,508 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:41,782 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4235591451611549021_1034 file build/test/data/dfs/data/data1/current/blk_-4235591451611549021 for deletion
2013-10-31 20:29:41,782 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_879783227615782819_1033 file build/test/data/dfs/data/data2/current/blk_879783227615782819 for deletion
2013-10-31 20:29:41,782 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4235591451611549021_1034 at file build/test/data/dfs/data/data1/current/blk_-4235591451611549021
2013-10-31 20:29:41,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7549334751741244840_1032 file build/test/data/dfs/data/data1/current/blk_7549334751741244840 for deletion
2013-10-31 20:29:41,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_879783227615782819_1033 at file build/test/data/dfs/data/data2/current/blk_879783227615782819
2013-10-31 20:29:41,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7549334751741244840_1032 at file build/test/data/dfs/data/data1/current/blk_7549334751741244840
2013-10-31 20:29:41,909 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0004_r_000000_0
2013-10-31 20:29:41,910 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0004_r_000000_0
2013-10-31 20:29:42,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5005083787941543205_1035 file build/test/data/dfs/data/data3/current/blk_-5005083787941543205 for deletion
2013-10-31 20:29:42,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4235591451611549021_1034 file build/test/data/dfs/data/data4/current/blk_-4235591451611549021 for deletion
2013-10-31 20:29:42,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5005083787941543205_1035 at file build/test/data/dfs/data/data3/current/blk_-5005083787941543205
2013-10-31 20:29:42,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_879783227615782819_1033 file build/test/data/dfs/data/data3/current/blk_879783227615782819 for deletion
2013-10-31 20:29:42,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4235591451611549021_1034 at file build/test/data/dfs/data/data4/current/blk_-4235591451611549021
2013-10-31 20:29:42,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7549334751741244840_1032 file build/test/data/dfs/data/data4/current/blk_7549334751741244840 for deletion
2013-10-31 20:29:42,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_879783227615782819_1033 at file build/test/data/dfs/data/data3/current/blk_879783227615782819
2013-10-31 20:29:42,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7549334751741244840_1032 at file build/test/data/dfs/data/data4/current/blk_7549334751741244840
2013-10-31 20:29:42,917 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0004_m_000001_0' has completed task_20131031202710049_0004_m_000001 successfully.
2013-10-31 20:29:42,918 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0004 has completed successfully.
2013-10-31 20:29:42,918 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0004,submitTime=1383251352502,launchTime=1383251352628,firstMapTaskLaunchTime=1383251358872,firstReduceTaskLaunchTime=1383251364884,firstJobSetupTaskLaunchTime=1383251352855,firstJobCleanupTaskLaunchTime=1383251376906,finishTime=1383251382918,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=14,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D88A272C6D674CC7B97262331F6897D9/430B5825EF1441D384C635C6F953CED2] lower*upper/(2/2) ...ue/true/false/false/false
2013-10-31 20:29:42,924 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_1383251352502_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2F430B5825EF1441D3. blk_-8339431791342127608_1040
2013-10-31 20:29:42,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8339431791342127608_1040 src: /127.0.0.1:43950 dest: /127.0.0.1:33202
2013-10-31 20:29:42,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8339431791342127608_1040 src: /127.0.0.1:39659 dest: /127.0.0.1:46399
2013-10-31 20:29:42,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8339431791342127608_1040 src: /127.0.0.1:34170 dest: /127.0.0.1:37249
2013-10-31 20:29:42,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34170, dest: /127.0.0.1:37249, bytes: 16920, op: HDFS_WRITE, cliID: DFSClient_1271040249, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8339431791342127608_1040, duration: 7614059
2013-10-31 20:29:42,942 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8339431791342127608_1040 terminating
2013-10-31 20:29:42,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39659, dest: /127.0.0.1:46399, bytes: 16920, op: HDFS_WRITE, cliID: DFSClient_1271040249, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8339431791342127608_1040, duration: 8976319
2013-10-31 20:29:42,944 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8339431791342127608_1040 size 16920
2013-10-31 20:29:42,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8339431791342127608_1040 terminating
2013-10-31 20:29:42,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43950, dest: /127.0.0.1:33202, bytes: 16920, op: HDFS_WRITE, cliID: DFSClient_1271040249, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8339431791342127608_1040, duration: 9298081
2013-10-31 20:29:42,945 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8339431791342127608_1040 terminating
2013-10-31 20:29:42,947 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8339431791342127608_1040 size 16920
2013-10-31 20:29:42,947 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_1383251352502_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2F430B5825EF1441D3 from client DFSClient_1271040249
2013-10-31 20:29:42,948 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_logs/history/job_20131031202710049_0004_1383251352502_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2F430B5825EF1441D3 is closed by DFSClient_1271040249
2013-10-31 20:29:42,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8339431791342127608_1040 size 16920
2013-10-31 20:29:42,953 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0004_1383251352502_hadoop_%5BD88A272C6D674CC7B97262331F6897D9%2F430B5825EF1441D3 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:29:42,955 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0004_m_000000_0'
2013-10-31 20:29:42,955 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0004_m_000001_0'
2013-10-31 20:29:42,956 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0004_m_000002_0'
2013-10-31 20:29:42,956 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0004_r_000000_0'
2013-10-31 20:29:42,957 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1785864765006837424 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:42,958 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1785864765006837424 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:42,958 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1785864765006837424 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:42,964 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0004_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:29:42,966 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8350257418098389693 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:42,966 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8350257418098389693 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:42,966 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8350257418098389693 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:42,966 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5715333056314841623 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:42,967 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5715333056314841623 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:29:42,967 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5715333056314841623 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:42,967 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8694324191132864288 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:29:42,967 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8694324191132864288 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:29:42,967 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8694324191132864288 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:29:42,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0004 dst=null perm=null
2013-10-31 20:29:42,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/742995729_lower_upper_EEDB7E1D59F541CDA6FB75002C7F525C dst=null perm=null
2013-10-31 20:29:42,977 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/_temporary
2013-10-31 20:29:43,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false dst=null perm=null
2013-10-31 20:29:43,001 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:43,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:29:43,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:29:43,008 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34172, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3218731179532037440_1039, duration: 502005
2013-10-31 20:29:43,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false dst=null perm=null
2013-10-31 20:29:43,032 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:43,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:29:43,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:29:43,036 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34173, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3218731179532037440_1039, duration: 467078
2013-10-31 20:29:43,037 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false
2013-10-31 20:29:43,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false dst=null perm=null
2013-10-31 20:29:43,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:29:43,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39664, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3218731179532037440_1039, duration: 489829
2013-10-31 20:29:43,058 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:29:43,058 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:29:43,080 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:29:43,081 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:29:43,081 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:29:43,081 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue"]
2013-10-31 20:29:43,082 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:29:43,082 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 20:29:43,083 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 20:29:43,084 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...orm/byteswritablekeyvalue
2013-10-31 20:29:43,091 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 20:29:43,092 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:29:43,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:43,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:29:43,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,112 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar. blk_-5661487864929242591_1041
2013-10-31 20:29:43,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5661487864929242591_1041 src: /127.0.0.1:34175 dest: /127.0.0.1:37249
2013-10-31 20:29:43,115 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5661487864929242591_1041 src: /127.0.0.1:39666 dest: /127.0.0.1:46399
2013-10-31 20:29:43,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5661487864929242591_1041 src: /127.0.0.1:35573 dest: /127.0.0.1:49827
2013-10-31 20:29:43,123 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35573, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5661487864929242591_1041, duration: 5298571
2013-10-31 20:29:43,124 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5661487864929242591_1041 terminating
2013-10-31 20:29:43,124 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39666, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5661487864929242591_1041, duration: 7571380
2013-10-31 20:29:43,125 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5661487864929242591_1041 terminating
2013-10-31 20:29:43,126 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34175, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-5661487864929242591_1041, duration: 7590466
2013-10-31 20:29:43,126 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5661487864929242591_1041 size 238055
2013-10-31 20:29:43,126 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5661487864929242591_1041 terminating
2013-10-31 20:29:43,128 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar from client DFSClient_848976415
2013-10-31 20:29:43,128 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar is closed by DFSClient_848976415
2013-10-31 20:29:43,128 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-5661487864929242591_1041 size 238055
2013-10-31 20:29:43,129 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-5661487864929242591_1041 size 238055
2013-10-31 20:29:43,134 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar. New replication is 10
2013-10-31 20:29:43,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar dst=null perm=null
2013-10-31 20:29:43,406 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37249 to replicate blk_-5661487864929242591_1041 to datanode(s) 127.0.0.1:33202
2013-10-31 20:29:43,406 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_1785864765006837424_1038 blk_-5715333056314841623_1028 blk_-8350257418098389693_1031
2013-10-31 20:29:43,406 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_879783227615782819_1033 blk_8694324191132864288_1030 blk_7549334751741244840_1032 blk_-5005083787941543205_1035 blk_-5715333056314841623_1028 blk_-8350257418098389693_1031
2013-10-31 20:29:43,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,414 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:29:43,418 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:43,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:29:43,420 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:43,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:29:43,423 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:43,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:29:43,425 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:29:43,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:29:43,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,445 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split. New replication is 10
2013-10-31 20:29:43,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:43,453 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split. blk_3050374350235301105_1042
2013-10-31 20:29:43,454 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3050374350235301105_1042 src: /127.0.0.1:35574 dest: /127.0.0.1:49827
2013-10-31 20:29:43,455 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3050374350235301105_1042 src: /127.0.0.1:39669 dest: /127.0.0.1:46399
2013-10-31 20:29:43,456 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3050374350235301105_1042 src: /127.0.0.1:34180 dest: /127.0.0.1:37249
2013-10-31 20:29:43,457 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3050374350235301105_1042 src: /127.0.0.1:43963 dest: /127.0.0.1:33202
2013-10-31 20:29:43,461 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43963, dest: /127.0.0.1:33202, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3050374350235301105_1042, duration: 2543307
2013-10-31 20:29:43,461 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3050374350235301105_1042 terminating
2013-10-31 20:29:43,463 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34180, dest: /127.0.0.1:37249, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3050374350235301105_1042, duration: 4223842
2013-10-31 20:29:43,463 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3050374350235301105_1042 terminating
2013-10-31 20:29:43,464 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39669, dest: /127.0.0.1:46399, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3050374350235301105_1042, duration: 5109353
2013-10-31 20:29:43,464 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3050374350235301105_1042 terminating
2013-10-31 20:29:43,464 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35574, dest: /127.0.0.1:49827, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3050374350235301105_1042, duration: 4338602
2013-10-31 20:29:43,464 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3050374350235301105_1042 terminating
2013-10-31 20:29:43,465 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3050374350235301105_1042 size 2077
2013-10-31 20:29:43,466 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split from client DFSClient_848976415
2013-10-31 20:29:43,466 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split is closed by DFSClient_848976415
2013-10-31 20:29:43,467 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3050374350235301105_1042 size 2077
2013-10-31 20:29:43,467 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3050374350235301105_1042 size 2077
2013-10-31 20:29:43,468 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3050374350235301105_1042 size 2077
2013-10-31 20:29:43,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,484 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.splitmetainfo. blk_-8057071573712851591_1043
2013-10-31 20:29:43,485 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8057071573712851591_1043 src: /127.0.0.1:35578 dest: /127.0.0.1:49827
2013-10-31 20:29:43,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8057071573712851591_1043 src: /127.0.0.1:34183 dest: /127.0.0.1:37249
2013-10-31 20:29:43,488 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8057071573712851591_1043 src: /127.0.0.1:39674 dest: /127.0.0.1:46399
2013-10-31 20:29:43,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39674, dest: /127.0.0.1:46399, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8057071573712851591_1043, duration: 1129221
2013-10-31 20:29:43,490 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8057071573712851591_1043 terminating
2013-10-31 20:29:43,491 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34183, dest: /127.0.0.1:37249, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8057071573712851591_1043, duration: 1511567
2013-10-31 20:29:43,492 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8057071573712851591_1043 terminating
2013-10-31 20:29:43,492 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35578, dest: /127.0.0.1:49827, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8057071573712851591_1043, duration: 2690660
2013-10-31 20:29:43,493 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8057071573712851591_1043 terminating
2013-10-31 20:29:43,493 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8057071573712851591_1043 size 218
2013-10-31 20:29:43,494 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8057071573712851591_1043 size 218
2013-10-31 20:29:43,495 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8057071573712851591_1043 size 218
2013-10-31 20:29:43,495 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:29:43,495 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:29:43,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,520 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml. blk_6049188892739496679_1044
2013-10-31 20:29:43,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6049188892739496679_1044 src: /127.0.0.1:34185 dest: /127.0.0.1:37249
2013-10-31 20:29:43,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6049188892739496679_1044 src: /127.0.0.1:39676 dest: /127.0.0.1:46399
2013-10-31 20:29:43,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6049188892739496679_1044 src: /127.0.0.1:35583 dest: /127.0.0.1:49827
2013-10-31 20:29:43,528 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35583, dest: /127.0.0.1:49827, bytes: 28857, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6049188892739496679_1044, duration: 1554490
2013-10-31 20:29:43,529 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6049188892739496679_1044 terminating
2013-10-31 20:29:43,530 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39676, dest: /127.0.0.1:46399, bytes: 28857, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6049188892739496679_1044, duration: 3045725
2013-10-31 20:29:43,531 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6049188892739496679_1044 terminating
2013-10-31 20:29:43,532 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34185, dest: /127.0.0.1:37249, bytes: 28857, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6049188892739496679_1044, duration: 5457766
2013-10-31 20:29:43,532 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6049188892739496679_1044 size 28857
2013-10-31 20:29:43,533 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6049188892739496679_1044 terminating
2013-10-31 20:29:43,533 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6049188892739496679_1044 size 28857
2013-10-31 20:29:43,537 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6049188892739496679_1044 size 28857
2013-10-31 20:29:43,537 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml from client DFSClient_848976415
2013-10-31 20:29:43,538 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml is closed by DFSClient_848976415
2013-10-31 20:29:43,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml dst=null perm=null
2013-10-31 20:29:43,556 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34189, bytes: 29085, op: HDFS_READ, cliID: DFSClient_1245866984, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6049188892739496679_1044, duration: 503405
2013-10-31 20:29:43,573 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0005: nMaps=6 nReduces=1 max=-1
2013-10-31 20:29:43,573 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0005 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:29:43,573 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0005 RESULT=SUCCESS
2013-10-31 20:29:43,573 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0005
2013-10-31 20:29:43,573 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0005
2013-10-31 20:29:43,575 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0005
2013-10-31 20:29:43,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_1383251383544_hadoop_%5B6A3D8C42ABDA4F74B8DEC45949F6B74B%2F5602D8EF3DC040E2 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,609 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_conf.xml. blk_-4485977131336952065_1046
2013-10-31 20:29:43,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4485977131336952065_1046 src: /127.0.0.1:39680 dest: /127.0.0.1:46399
2013-10-31 20:29:43,611 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4485977131336952065_1046 src: /127.0.0.1:43973 dest: /127.0.0.1:33202
2013-10-31 20:29:43,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4485977131336952065_1046 src: /127.0.0.1:34192 dest: /127.0.0.1:37249
2013-10-31 20:29:43,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34192, dest: /127.0.0.1:37249, bytes: 28922, op: HDFS_WRITE, cliID: DFSClient_1245866984, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4485977131336952065_1046, duration: 957835
2013-10-31 20:29:43,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4485977131336952065_1046 terminating
2013-10-31 20:29:43,615 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4485977131336952065_1046 size 28922
2013-10-31 20:29:43,615 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43973, dest: /127.0.0.1:33202, bytes: 28922, op: HDFS_WRITE, cliID: DFSClient_1245866984, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4485977131336952065_1046, duration: 1787669
2013-10-31 20:29:43,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4485977131336952065_1046 terminating
2013-10-31 20:29:43,616 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39680, dest: /127.0.0.1:46399, bytes: 28922, op: HDFS_WRITE, cliID: DFSClient_1245866984, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4485977131336952065_1046, duration: 2604751
2013-10-31 20:29:43,616 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4485977131336952065_1046 terminating
2013-10-31 20:29:43,618 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4485977131336952065_1046 size 28922
2013-10-31 20:29:43,618 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_conf.xml from client DFSClient_1245866984
2013-10-31 20:29:43,618 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_conf.xml is closed by DFSClient_1245866984
2013-10-31 20:29:43,620 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4485977131336952065_1046 size 28922
2013-10-31 20:29:43,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:29:43,631 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken. blk_4103253142703256918_1047
2013-10-31 20:29:43,631 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4103253142703256918_1047 src: /127.0.0.1:39683 dest: /127.0.0.1:46399
2013-10-31 20:29:43,632 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4103253142703256918_1047 src: /127.0.0.1:34194 dest: /127.0.0.1:37249
2013-10-31 20:29:43,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4103253142703256918_1047 src: /127.0.0.1:35591 dest: /127.0.0.1:49827
2013-10-31 20:29:43,635 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35591, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4103253142703256918_1047, duration: 1114232
2013-10-31 20:29:43,635 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4103253142703256918_1047 terminating
2013-10-31 20:29:43,635 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34194, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4103253142703256918_1047, duration: 1463554
2013-10-31 20:29:43,635 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4103253142703256918_1047 terminating
2013-10-31 20:29:43,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39683, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4103253142703256918_1047, duration: 1800405
2013-10-31 20:29:43,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4103253142703256918_1047 terminating
2013-10-31 20:29:43,638 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_4103253142703256918_1047 size 116
2013-10-31 20:29:43,638 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken from client DFSClient_848976415
2013-10-31 20:29:43,638 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken is closed by DFSClient_848976415
2013-10-31 20:29:43,638 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_4103253142703256918_1047 size 116
2013-10-31 20:29:43,639 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_4103253142703256918_1047 size 116
2013-10-31 20:29:43,768 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0004
2013-10-31 20:29:43,768 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0004 being deleted.
2013-10-31 20:29:44,002 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken
2013-10-31 20:29:44,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.splitmetainfo dst=null perm=null
2013-10-31 20:29:44,007 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35592, bytes: 222, op: HDFS_READ, cliID: DFSClient_1245866984, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8057071573712851591_1043, duration: 381695
2013-10-31 20:29:44,010 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0005 = 38. Number of splits = 6
2013-10-31 20:29:44,010 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,011 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,011 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,011 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,011 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,012 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,012 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,012 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,012 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,012 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,013 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,013 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,013 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,013 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,013 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,014 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,014 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,014 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0005_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:29:44,014 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0005 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:29:44,015 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0005 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 20:29:44,408 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0005_m_000007_0' to tip task_20131031202710049_0005_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:29:44,414 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000007_0 task's state:UNASSIGNED
2013-10-31 20:29:44,415 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000007_0 which needs 1 slots
2013-10-31 20:29:44,415 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0004
2013-10-31 20:29:44,415 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0005_m_000007_0 which needs 1 slots
2013-10-31 20:29:44,415 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0004 being deleted.
2013-10-31 20:29:44,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken dst=null perm=null
2013-10-31 20:29:44,426 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35593, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4103253142703256918_1047, duration: 454424
2013-10-31 20:29:44,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml dst=null perm=null
2013-10-31 20:29:44,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35595, bytes: 29085, op: HDFS_READ, cliID: DFSClient_-1736805592, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6049188892739496679_1044, duration: 533719
2013-10-31 20:29:44,473 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:29:44,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar dst=null perm=null
2013-10-31 20:29:44,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39690, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1736805592, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5661487864929242591_1041, duration: 1773487
2013-10-31 20:29:44,613 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_m_-579525522
2013-10-31 20:29:44,614 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_m_-579525522 spawned.
2013-10-31 20:29:44,615 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_m_000007_0/taskjvm.sh
2013-10-31 20:29:44,783 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642) Starting thread to transfer block blk_-5661487864929242591_1041 to 127.0.0.1:33202
2013-10-31 20:29:44,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8350257418098389693_1031 file build/test/data/dfs/data/data2/current/blk_-8350257418098389693 for deletion
2013-10-31 20:29:44,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5715333056314841623_1028 file build/test/data/dfs/data/data2/current/blk_-5715333056314841623 for deletion
2013-10-31 20:29:44,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1785864765006837424_1038 file build/test/data/dfs/data/data2/current/blk_1785864765006837424 for deletion
2013-10-31 20:29:44,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5661487864929242591_1041 src: /127.0.0.1:43983 dest: /127.0.0.1:33202
2013-10-31 20:29:44,786 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642):Transmitted block blk_-5661487864929242591_1041 to /127.0.0.1:33202
2013-10-31 20:29:44,795 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8350257418098389693_1031 at file build/test/data/dfs/data/data2/current/blk_-8350257418098389693
2013-10-31 20:29:44,795 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5715333056314841623_1028 at file build/test/data/dfs/data/data2/current/blk_-5715333056314841623
2013-10-31 20:29:44,795 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1785864765006837424_1038 at file build/test/data/dfs/data/data2/current/blk_1785864765006837424
2013-10-31 20:29:44,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5661487864929242591_1041 src: /127.0.0.1:43983 dest: /127.0.0.1:33202 of size 238055
2013-10-31 20:29:44,801 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-5661487864929242591_1041 size 238055
2013-10-31 20:29:44,998 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0004
2013-10-31 20:29:44,998 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0004 being deleted.
2013-10-31 20:29:45,590 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_-579525522 given task: attempt_20131031202710049_0005_m_000007_0
2013-10-31 20:29:46,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8350257418098389693_1031 file build/test/data/dfs/data/data8/current/blk_-8350257418098389693 for deletion
2013-10-31 20:29:46,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5715333056314841623_1028 file build/test/data/dfs/data/data8/current/blk_-5715333056314841623 for deletion
2013-10-31 20:29:46,058 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8350257418098389693_1031 at file build/test/data/dfs/data/data8/current/blk_-8350257418098389693
2013-10-31 20:29:46,058 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5005083787941543205_1035 file build/test/data/dfs/data/data8/current/blk_-5005083787941543205 for deletion
2013-10-31 20:29:46,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5715333056314841623_1028 at file build/test/data/dfs/data/data8/current/blk_-5715333056314841623
2013-10-31 20:29:46,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_879783227615782819_1033 file build/test/data/dfs/data/data7/current/blk_879783227615782819 for deletion
2013-10-31 20:29:46,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5005083787941543205_1035 at file build/test/data/dfs/data/data8/current/blk_-5005083787941543205
2013-10-31 20:29:46,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_879783227615782819_1033 at file build/test/data/dfs/data/data7/current/blk_879783227615782819
2013-10-31 20:29:46,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7549334751741244840_1032 file build/test/data/dfs/data/data8/current/blk_7549334751741244840 for deletion
2013-10-31 20:29:46,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8694324191132864288_1030 file build/test/data/dfs/data/data7/current/blk_8694324191132864288 for deletion
2013-10-31 20:29:46,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7549334751741244840_1032 at file build/test/data/dfs/data/data8/current/blk_7549334751741244840
2013-10-31 20:29:46,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8694324191132864288_1030 at file build/test/data/dfs/data/data7/current/blk_8694324191132864288
2013-10-31 20:29:46,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:29:46,407 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_879783227615782819_1033 blk_8694324191132864288_1030 blk_7549334751741244840_1032 blk_-4235591451611549021_1034 blk_-5005083787941543205_1035 blk_1785864765006837424_1038 blk_-5715333056314841623_1028
2013-10-31 20:29:46,407 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_8694324191132864288_1030 blk_1785864765006837424_1038 blk_-8350257418098389693_1031
2013-10-31 20:29:47,666 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_1923996118185355645_1011
2013-10-31 20:29:47,958 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0004
2013-10-31 20:29:47,958 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0004_m_000001_0 not found in cache
2013-10-31 20:29:47,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0004 for user-log deletion with retainTimeStamp:1383337787959
2013-10-31 20:29:47,968 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0004_m_3239044 since job job_20131031202710049_0004 is dead
2013-10-31 20:29:47,978 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26806 with signal TERM. Exit code 0
2013-10-31 20:29:48,045 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0004_m_-781670435 since job job_20131031202710049_0004 is dead
2013-10-31 20:29:48,049 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26685 with signal TERM. Exit code 0
2013-10-31 20:29:48,185 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:48,185 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:48,185 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:48,186 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0004_m_3239044 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:29:48,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8350257418098389693_1031 file build/test/data/dfs/data/data3/current/blk_-8350257418098389693 for deletion
2013-10-31 20:29:48,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8350257418098389693_1031 at file build/test/data/dfs/data/data3/current/blk_-8350257418098389693
2013-10-31 20:29:48,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1785864765006837424_1038 file build/test/data/dfs/data/data3/current/blk_1785864765006837424 for deletion
2013-10-31 20:29:48,231 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:48,232 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:48,232 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:48,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1785864765006837424_1038 at file build/test/data/dfs/data/data3/current/blk_1785864765006837424
2013-10-31 20:29:48,232 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0004_m_-781670435 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:29:48,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8694324191132864288_1030 file build/test/data/dfs/data/data4/current/blk_8694324191132864288 for deletion
2013-10-31 20:29:48,233 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8694324191132864288_1030 at file build/test/data/dfs/data/data4/current/blk_8694324191132864288
2013-10-31 20:29:48,673 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5715333056314841623_1028 file build/test/data/dfs/data/data5/current/blk_-5715333056314841623 for deletion
2013-10-31 20:29:48,673 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5005083787941543205_1035 file build/test/data/dfs/data/data5/current/blk_-5005083787941543205 for deletion
2013-10-31 20:29:48,673 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5715333056314841623_1028 at file build/test/data/dfs/data/data5/current/blk_-5715333056314841623
2013-10-31 20:29:48,673 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4235591451611549021_1034 file build/test/data/dfs/data/data6/current/blk_-4235591451611549021 for deletion
2013-10-31 20:29:48,674 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5005083787941543205_1035 at file build/test/data/dfs/data/data5/current/blk_-5005083787941543205
2013-10-31 20:29:48,674 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4235591451611549021_1034 at file build/test/data/dfs/data/data6/current/blk_-4235591451611549021
2013-10-31 20:29:48,674 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_879783227615782819_1033 file build/test/data/dfs/data/data5/current/blk_879783227615782819 for deletion
2013-10-31 20:29:48,675 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1785864765006837424_1038 file build/test/data/dfs/data/data5/current/blk_1785864765006837424 for deletion
2013-10-31 20:29:48,675 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_879783227615782819_1033 at file build/test/data/dfs/data/data5/current/blk_879783227615782819
2013-10-31 20:29:48,675 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7549334751741244840_1032 file build/test/data/dfs/data/data6/current/blk_7549334751741244840 for deletion
2013-10-31 20:29:48,675 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1785864765006837424_1038 at file build/test/data/dfs/data/data5/current/blk_1785864765006837424
2013-10-31 20:29:48,675 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8694324191132864288_1030 file build/test/data/dfs/data/data5/current/blk_8694324191132864288 for deletion
2013-10-31 20:29:48,676 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7549334751741244840_1032 at file build/test/data/dfs/data/data6/current/blk_7549334751741244840
2013-10-31 20:29:48,676 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8694324191132864288_1030 at file build/test/data/dfs/data/data5/current/blk_8694324191132864288
2013-10-31 20:29:49,031 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000007_0 0.0% setup
2013-10-31 20:29:49,034 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000007_0 is done.
2013-10-31 20:29:49,034 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000007_0 was -1
2013-10-31 20:29:49,034 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:49,327 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0004_r_1148474272 since job job_20131031202710049_0004 is dead
2013-10-31 20:29:49,338 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26877 with signal TERM. Exit code 0
2013-10-31 20:29:49,518 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:29:49,519 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:29:49,519 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:29:49,519 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0004_r_1148474272 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:29:50,421 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000007_0' has completed task_20131031202710049_0005_m_000007 successfully.
2013-10-31 20:29:50,939 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0005_m_000000_0' to tip task_20131031202710049_0005_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:29:50,941 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0005_m_000000
2013-10-31 20:29:50,941 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0005_m_000001_0' to tip task_20131031202710049_0005_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:29:50,942 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0005_m_000001
2013-10-31 20:29:50,944 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:29:50,945 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:29:50,945 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000000_0 which needs 1 slots
2013-10-31 20:29:50,946 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0005_m_000000_0 which needs 1 slots
2013-10-31 20:29:50,946 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000001_0 which needs 1 slots
2013-10-31 20:29:50,947 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0005_m_000001_0 which needs 1 slots
2013-10-31 20:29:50,995 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_m_-51669306
2013-10-31 20:29:50,996 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_m_-51669306 spawned.
2013-10-31 20:29:50,997 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0005/attempt_20131031202710049_0005_m_000000_0. Attempting to reuse: jvm_20131031202710049_0005_m_-579525522
2013-10-31 20:29:51,001 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_m_000001_0/taskjvm.sh
2013-10-31 20:29:51,005 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0005_m_000002_0' to tip task_20131031202710049_0005_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:29:51,006 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0005_m_000002
2013-10-31 20:29:51,006 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0005_m_000003_0' to tip task_20131031202710049_0005_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:29:51,026 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0005_m_000003
2013-10-31 20:29:51,029 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:29:51,030 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:29:51,030 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000002_0 which needs 1 slots
2013-10-31 20:29:51,031 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0005_m_000002_0 which needs 1 slots
2013-10-31 20:29:51,031 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000003_0 which needs 1 slots
2013-10-31 20:29:51,031 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0005_m_000003_0 which needs 1 slots
2013-10-31 20:29:51,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken dst=null perm=null
2013-10-31 20:29:51,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35600, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4103253142703256918_1047, duration: 317704
2013-10-31 20:29:51,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml dst=null perm=null
2013-10-31 20:29:51,056 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34206, bytes: 29085, op: HDFS_READ, cliID: DFSClient_-373666184, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6049188892739496679_1044, duration: 498001
2013-10-31 20:29:51,093 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:29:51,101 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_-579525522 given task: attempt_20131031202710049_0005_m_000000_0
2013-10-31 20:29:51,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar dst=null perm=null
2013-10-31 20:29:51,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35603, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-373666184, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5661487864929242591_1041, duration: 1448910
2013-10-31 20:29:51,184 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_m_-658343481
2013-10-31 20:29:51,185 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_m_-658343481 spawned.
2013-10-31 20:29:51,186 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_m_1094366995
2013-10-31 20:29:51,186 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_m_1094366995 spawned.
2013-10-31 20:29:51,187 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_m_000003_0/taskjvm.sh
2013-10-31 20:29:51,188 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_m_000002_0/taskjvm.sh
2013-10-31 20:29:51,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:51,217 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34209, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3050374350235301105_1042, duration: 197085
2013-10-31 20:29:51,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:29:51,580 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39700, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 165692
2013-10-31 20:29:51,855 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_-51669306 given task: attempt_20131031202710049_0005_m_000001_0
2013-10-31 20:29:51,965 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0005_m_000004_0' to tip task_20131031202710049_0005_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:29:51,965 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0005_m_000004
2013-10-31 20:29:51,965 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0005_m_000005_0' to tip task_20131031202710049_0005_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:29:51,965 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0005_m_000005
2013-10-31 20:29:51,966 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000004_0 task's state:UNASSIGNED
2013-10-31 20:29:51,967 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000005_0 task's state:UNASSIGNED
2013-10-31 20:29:51,967 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000004_0 which needs 1 slots
2013-10-31 20:29:51,967 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0005_m_000004_0 which needs 1 slots
2013-10-31 20:29:51,967 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000005_0 which needs 1 slots
2013-10-31 20:29:51,967 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0005_m_000005_0 which needs 1 slots
2013-10-31 20:29:51,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005/jobToken dst=null perm=null
2013-10-31 20:29:52,010 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35609, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4103253142703256918_1047, duration: 1382410
2013-10-31 20:29:52,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.xml dst=null perm=null
2013-10-31 20:29:52,016 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39705, bytes: 29085, op: HDFS_READ, cliID: DFSClient_1624671126, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6049188892739496679_1044, duration: 204676
2013-10-31 20:29:52,030 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:29:52,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.jar dst=null perm=null
2013-10-31 20:29:52,047 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35613, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1624671126, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5661487864929242591_1041, duration: 794538
2013-10-31 20:29:52,105 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_m_-218308890
2013-10-31 20:29:52,106 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_m_-218308890 spawned.
2013-10-31 20:29:52,106 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_m_583226979
2013-10-31 20:29:52,107 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_m_583226979 spawned.
2013-10-31 20:29:52,108 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_m_000005_0/taskjvm.sh
2013-10-31 20:29:52,108 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_m_000004_0/taskjvm.sh
2013-10-31 20:29:52,168 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_-658343481 given task: attempt_20131031202710049_0005_m_000003_0
2013-10-31 20:29:52,187 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_1094366995 given task: attempt_20131031202710049_0005_m_000002_0
2013-10-31 20:29:52,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:52,743 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39711, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3050374350235301105_1042, duration: 191909
2013-10-31 20:29:52,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:52,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34222, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000002_0, offset: 512, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3050374350235301105_1042, duration: 183770
2013-10-31 20:29:52,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:52,780 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35619, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000003_0, offset: 1024, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3050374350235301105_1042, duration: 166479
2013-10-31 20:29:52,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:29:52,783 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39714, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 124102
2013-10-31 20:29:52,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:29:52,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:29:52,820 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35621, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000003_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 149406
2013-10-31 20:29:53,078 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34227, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000002_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 208889
2013-10-31 20:29:53,275 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_-218308890 given task: attempt_20131031202710049_0005_m_000005_0
2013-10-31 20:29:53,438 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_583226979 given task: attempt_20131031202710049_0005_m_000004_0
2013-10-31 20:29:53,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:53,788 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44013, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000005_0, offset: 1536, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3050374350235301105_1042, duration: 189761
2013-10-31 20:29:53,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:29:53,827 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39722, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000005_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1710730409183361578_1012, duration: 133189
2013-10-31 20:29:53,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005/job.split dst=null perm=null
2013-10-31 20:29:53,932 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44016, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000004_0, offset: 1024, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3050374350235301105_1042, duration: 198678
2013-10-31 20:29:53,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:29:53,971 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44017, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0005_m_000004_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4376294229090259720_1013, duration: 131402
2013-10-31 20:29:54,180 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 20:29:54,182 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000000_0 is done.
2013-10-31 20:29:54,183 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000000_0 was 63
2013-10-31 20:29:54,183 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:29:55,671 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 20:29:55,675 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000001_0 is done.
2013-10-31 20:29:55,675 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000001_0 was 44
2013-10-31 20:29:55,675 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:55,697 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000002_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 20:29:55,700 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000002_0 is done.
2013-10-31 20:29:55,700 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000002_0 was 63
2013-10-31 20:29:55,700 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:29:55,711 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000003_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 20:29:55,712 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000003_0 is done.
2013-10-31 20:29:55,712 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000003_0 was 44
2013-10-31 20:29:55,713 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:55,945 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0005_m_000007_0
2013-10-31 20:29:55,946 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0005_m_000007_0
2013-10-31 20:29:55,946 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0005_m_000007_0 not found in cache
2013-10-31 20:29:56,719 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000005_0 0.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 20:29:56,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000005_0 is done.
2013-10-31 20:29:56,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000005_0 was 6
2013-10-31 20:29:56,722 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:29:56,862 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000004_0 0.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 20:29:56,865 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000004_0 is done.
2013-10-31 20:29:56,865 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000004_0 was 6
2013-10-31 20:29:56,865 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:29:56,949 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000000_0' has completed task_20131031202710049_0005_m_000000 successfully.
2013-10-31 20:29:56,951 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000001_0' has completed task_20131031202710049_0005_m_000001 successfully.
2013-10-31 20:29:56,953 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0005_r_000000_0' to tip task_20131031202710049_0005_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:29:56,956 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:29:56,956 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_r_000000_0 which needs 1 slots
2013-10-31 20:29:56,956 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0005_r_000000_0 which needs 1 slots
2013-10-31 20:29:56,995 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0005_r_322169434
2013-10-31 20:29:56,995 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0005_r_322169434 spawned.
2013-10-31 20:29:56,998 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0005/attempt_20131031202710049_0005_r_000000_0/taskjvm.sh
2013-10-31 20:29:57,035 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000002_0' has completed task_20131031202710049_0005_m_000002 successfully.
2013-10-31 20:29:57,231 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000003_0' has completed task_20131031202710049_0005_m_000003 successfully.
2013-10-31 20:29:57,971 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000004_0' has completed task_20131031202710049_0005_m_000004 successfully.
2013-10-31 20:29:57,972 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000005_0' has completed task_20131031202710049_0005_m_000005 successfully.
2013-10-31 20:29:58,072 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_r_322169434 given task: attempt_20131031202710049_0005_r_000000_0
2013-10-31 20:30:03,774 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53571, bytes: 63, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0005_m_000000_0, duration: 5959308
2013-10-31 20:30:03,785 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53571, bytes: 44, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0005_m_000001_0, duration: 4871506
2013-10-31 20:30:03,793 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:45302, bytes: 63, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0005_m_000002_0, duration: 6633367
2013-10-31 20:30:03,800 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:45302, bytes: 44, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0005_m_000003_0, duration: 4994681
2013-10-31 20:30:03,807 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52907, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0005_m_000004_0, duration: 5615961
2013-10-31 20:30:03,814 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52907, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0005_m_000005_0, duration: 4726894
2013-10-31 20:30:04,547 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:30:04,634 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:30:04,700 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:30:04,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:04,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:04,925 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0/part-00000. blk_3866802708261171957_1048
2013-10-31 20:30:04,961 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866802708261171957_1048 src: /127.0.0.1:39732 dest: /127.0.0.1:46399
2013-10-31 20:30:04,962 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866802708261171957_1048 src: /127.0.0.1:34243 dest: /127.0.0.1:37249
2013-10-31 20:30:04,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866802708261171957_1048 src: /127.0.0.1:44026 dest: /127.0.0.1:33202
2013-10-31 20:30:04,965 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44026, dest: /127.0.0.1:33202, bytes: 50, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0005_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3866802708261171957_1048, duration: 1421551
2013-10-31 20:30:04,965 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3866802708261171957_1048 terminating
2013-10-31 20:30:04,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34243, dest: /127.0.0.1:37249, bytes: 50, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0005_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3866802708261171957_1048, duration: 2473332
2013-10-31 20:30:04,967 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3866802708261171957_1048 size 50
2013-10-31 20:30:04,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3866802708261171957_1048 terminating
2013-10-31 20:30:04,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39732, dest: /127.0.0.1:46399, bytes: 50, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0005_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3866802708261171957_1048, duration: 4675554
2013-10-31 20:30:04,969 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3866802708261171957_1048 terminating
2013-10-31 20:30:04,971 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3866802708261171957_1048 size 50
2013-10-31 20:30:04,971 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0005_r_000000_0
2013-10-31 20:30:04,971 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0005_r_000000_0
2013-10-31 20:30:04,971 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3866802708261171957_1048 size 50
2013-10-31 20:30:05,009 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0005_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:30:05,009 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:30:05,965 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031202710049_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:55898
2013-10-31 20:30:05,966 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0005_r_000000_0
2013-10-31 20:30:06,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0 dst=null perm=null
2013-10-31 20:30:06,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:06,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:06,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary/_attempt_20131031202710049_0005_r_000000_0 dst=null perm=null
2013-10-31 20:30:07,593 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 20:30:07,594 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 20:30:07,595 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_r_000000_0 is done.
2013-10-31 20:30:07,595 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_r_000000_0 was -1
2013-10-31 20:30:07,595 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:08,043 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:30:08,049 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:30:08,055 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:30:08,060 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:30:08,066 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:30:08,072 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:30:08,078 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:30:08,078 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:30:08,969 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_r_000000_0' has completed task_20131031202710049_0005_r_000000 successfully.
2013-10-31 20:30:08,973 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0005_m_000006_0' to tip task_20131031202710049_0005_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:30:08,976 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0005_m_000006_0 task's state:UNASSIGNED
2013-10-31 20:30:08,976 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0005_m_000006_0 which needs 1 slots
2013-10-31 20:30:08,976 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0005_m_000006_0 which needs 1 slots
2013-10-31 20:30:09,013 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0005/attempt_20131031202710049_0005_m_000006_0. Attempting to reuse: jvm_20131031202710049_0005_m_-579525522
2013-10-31 20:30:09,716 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0005_m_-579525522 given task: attempt_20131031202710049_0005_m_000006_0
2013-10-31 20:30:09,797 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000006_0 0.0%
2013-10-31 20:30:09,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary dst=null perm=null
2013-10-31 20:30:09,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:09,815 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_SUCCESS from client DFSClient_attempt_20131031202710049_0005_m_000006_0
2013-10-31 20:30:09,815 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0005_m_000006_0
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5661487864929242591 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5661487864929242591 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5661487864929242591 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5661487864929242591 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3050374350235301105 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3050374350235301105 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3050374350235301105 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3050374350235301105 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8057071573712851591 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:09,821 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8057071573712851591 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:09,822 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8057071573712851591 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:09,822 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6049188892739496679 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:09,822 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6049188892739496679 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:09,822 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6049188892739496679 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:09,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0005 dst=null perm=null
2013-10-31 20:30:10,411 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-5661487864929242591_1041 blk_6049188892739496679_1044 blk_3050374350235301105_1042 blk_-8057071573712851591_1043
2013-10-31 20:30:10,411 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-5661487864929242591_1041 blk_3050374350235301105_1042
2013-10-31 20:30:12,239 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5661487864929242591_1041 file build/test/data/dfs/data/data4/current/blk_-5661487864929242591 for deletion
2013-10-31 20:30:12,239 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3050374350235301105_1042 file build/test/data/dfs/data/data4/current/blk_3050374350235301105 for deletion
2013-10-31 20:30:12,240 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5661487864929242591_1041 at file build/test/data/dfs/data/data4/current/blk_-5661487864929242591
2013-10-31 20:30:12,240 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3050374350235301105_1042 at file build/test/data/dfs/data/data4/current/blk_3050374350235301105
2013-10-31 20:30:12,681 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8057071573712851591_1043 file build/test/data/dfs/data/data6/current/blk_-8057071573712851591 for deletion
2013-10-31 20:30:12,681 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5661487864929242591_1041 file build/test/data/dfs/data/data6/current/blk_-5661487864929242591 for deletion
2013-10-31 20:30:12,681 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8057071573712851591_1043 at file build/test/data/dfs/data/data6/current/blk_-8057071573712851591
2013-10-31 20:30:12,682 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3050374350235301105_1042 file build/test/data/dfs/data/data5/current/blk_3050374350235301105 for deletion
2013-10-31 20:30:12,682 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5661487864929242591_1041 at file build/test/data/dfs/data/data6/current/blk_-5661487864929242591
2013-10-31 20:30:12,682 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3050374350235301105_1042 at file build/test/data/dfs/data/data5/current/blk_3050374350235301105
2013-10-31 20:30:12,682 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6049188892739496679_1044 file build/test/data/dfs/data/data5/current/blk_6049188892739496679 for deletion
2013-10-31 20:30:12,683 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6049188892739496679_1044 at file build/test/data/dfs/data/data5/current/blk_6049188892739496679
2013-10-31 20:30:12,771 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0005_m_000006_0 0.0% cleanup
2013-10-31 20:30:12,773 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0005_m_000006_0 is done.
2013-10-31 20:30:12,773 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0005_m_000006_0 was -1
2013-10-31 20:30:12,773 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:13,411 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-5661487864929242591_1041 blk_6049188892739496679_1044 blk_3050374350235301105_1042 blk_-8057071573712851591_1043
2013-10-31 20:30:13,412 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-5661487864929242591_1041 blk_6049188892739496679_1044 blk_3050374350235301105_1042 blk_-8057071573712851591_1043
2013-10-31 20:30:13,976 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0005_r_000000_0
2013-10-31 20:30:13,976 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0005_r_000000_0
2013-10-31 20:30:14,793 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8057071573712851591_1043 file build/test/data/dfs/data/data1/current/blk_-8057071573712851591 for deletion
2013-10-31 20:30:14,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5661487864929242591_1041 file build/test/data/dfs/data/data1/current/blk_-5661487864929242591 for deletion
2013-10-31 20:30:14,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8057071573712851591_1043 at file build/test/data/dfs/data/data1/current/blk_-8057071573712851591
2013-10-31 20:30:14,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3050374350235301105_1042 file build/test/data/dfs/data/data2/current/blk_3050374350235301105 for deletion
2013-10-31 20:30:14,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5661487864929242591_1041 at file build/test/data/dfs/data/data1/current/blk_-5661487864929242591
2013-10-31 20:30:14,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6049188892739496679_1044 file build/test/data/dfs/data/data2/current/blk_6049188892739496679 for deletion
2013-10-31 20:30:14,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3050374350235301105_1042 at file build/test/data/dfs/data/data2/current/blk_3050374350235301105
2013-10-31 20:30:14,795 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6049188892739496679_1044 at file build/test/data/dfs/data/data2/current/blk_6049188892739496679
2013-10-31 20:30:14,983 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0005_m_000006_0' has completed task_20131031202710049_0005_m_000006 successfully.
2013-10-31 20:30:14,984 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0005 has completed successfully.
2013-10-31 20:30:14,984 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0005,submitTime=1383251383544,launchTime=1383251384014,firstMapTaskLaunchTime=1383251390939,firstReduceTaskLaunchTime=1383251396953,firstJobSetupTaskLaunchTime=1383251384408,firstJobCleanupTaskLaunchTime=1383251408973,finishTime=1383251414984,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[6A3D8C42ABDA4F74B8DEC45949F6B74B/5602D8EF3DC040E2BB438BACD480277A] lower*upper/(1/1) ...orm/byteswritablekeyvalue
2013-10-31 20:30:14,991 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_1383251383544_hadoop_%5B6A3D8C42ABDA4F74B8DEC45949F6B74B%2F5602D8EF3DC040E2. blk_-2633881617539490211_1049
2013-10-31 20:30:14,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2633881617539490211_1049 src: /127.0.0.1:39741 dest: /127.0.0.1:46399
2013-10-31 20:30:14,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2633881617539490211_1049 src: /127.0.0.1:35648 dest: /127.0.0.1:49827
2013-10-31 20:30:14,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2633881617539490211_1049 src: /127.0.0.1:34253 dest: /127.0.0.1:37249
2013-10-31 20:30:15,009 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34253, dest: /127.0.0.1:37249, bytes: 34979, op: HDFS_WRITE, cliID: DFSClient_1245866984, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2633881617539490211_1049, duration: 6237988
2013-10-31 20:30:15,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2633881617539490211_1049 terminating
2013-10-31 20:30:15,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35648, dest: /127.0.0.1:49827, bytes: 34979, op: HDFS_WRITE, cliID: DFSClient_1245866984, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2633881617539490211_1049, duration: 5745836
2013-10-31 20:30:15,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2633881617539490211_1049 terminating
2013-10-31 20:30:15,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-2633881617539490211_1049 size 34979
2013-10-31 20:30:15,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39741, dest: /127.0.0.1:46399, bytes: 34979, op: HDFS_WRITE, cliID: DFSClient_1245866984, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2633881617539490211_1049, duration: 12718444
2013-10-31 20:30:15,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-2633881617539490211_1049 size 34979
2013-10-31 20:30:15,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2633881617539490211_1049 terminating
2013-10-31 20:30:15,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-2633881617539490211_1049 size 34979
2013-10-31 20:30:15,023 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_1383251383544_hadoop_%5B6A3D8C42ABDA4F74B8DEC45949F6B74B%2F5602D8EF3DC040E2 from client DFSClient_1245866984
2013-10-31 20:30:15,024 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_logs/history/job_20131031202710049_0005_1383251383544_hadoop_%5B6A3D8C42ABDA4F74B8DEC45949F6B74B%2F5602D8EF3DC040E2 is closed by DFSClient_1245866984
2013-10-31 20:30:15,024 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 268 Total time for transactions(ms): 8Number of transactions batched in Syncs: 9 Number of syncs: 176 SyncTimes(ms): 4557 749
2013-10-31 20:30:15,037 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0005_1383251383544_hadoop_%5B6A3D8C42ABDA4F74B8DEC45949F6B74B%2F5602D8EF3DC040E2 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:30:15,038 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000000_0'
2013-10-31 20:30:15,038 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000001_0'
2013-10-31 20:30:15,038 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000006_0'
2013-10-31 20:30:15,038 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000007_0'
2013-10-31 20:30:15,039 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_r_000000_0'
2013-10-31 20:30:15,040 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4103253142703256918 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:15,040 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4103253142703256918 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:15,040 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4103253142703256918 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:15,047 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0005_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:30:15,048 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/_temporary
2013-10-31 20:30:15,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0005 dst=null perm=null
2013-10-31 20:30:15,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue dst=null perm=null
2013-10-31 20:30:15,109 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:30:15,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:30:15,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:30:15,112 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34255, bytes: 54, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3866802708261171957_1048, duration: 122123
2013-10-31 20:30:15,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue dst=null perm=null
2013-10-31 20:30:15,121 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:30:15,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:30:15,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:30:15,125 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39746, bytes: 54, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3866802708261171957_1048, duration: 302203
2013-10-31 20:30:15,125 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/byteswritablekeyvalue
2013-10-31 20:30:15,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue dst=null perm=null
2013-10-31 20:30:15,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/byteswritablekeyvalue/part-00000 dst=null perm=null
2013-10-31 20:30:15,130 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44039, bytes: 54, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3866802708261171957_1048, duration: 284478
2013-10-31 20:30:15,139 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:30:15,139 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:30:15,153 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 20:30:15,154 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line' | cascading.tuple.coerce.BigDecimalCoerce@4ec88c68, String]->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 20:30:15,154 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["SequenceFile[['offset', 'count' | cascading.tuple.coerce.BigDecimalCoerce@4ec88c68, long]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal"]
2013-10-31 20:30:15,154 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 20:30:15,155 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 20:30:15,155 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 20:30:15,155 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...dpipesplatform/bigdecimal
2013-10-31 20:30:15,159 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 20:30:15,159 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:30:15,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:15,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:30:15,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,185 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar. blk_3286762115456329224_1050
2013-10-31 20:30:15,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3286762115456329224_1050 src: /127.0.0.1:39748 dest: /127.0.0.1:46399
2013-10-31 20:30:15,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3286762115456329224_1050 src: /127.0.0.1:44041 dest: /127.0.0.1:33202
2013-10-31 20:30:15,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3286762115456329224_1050 src: /127.0.0.1:35656 dest: /127.0.0.1:49827
2013-10-31 20:30:15,199 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35656, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3286762115456329224_1050, duration: 4141863
2013-10-31 20:30:15,200 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3286762115456329224_1050 terminating
2013-10-31 20:30:15,201 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44041, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3286762115456329224_1050, duration: 5573471
2013-10-31 20:30:15,201 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3286762115456329224_1050 terminating
2013-10-31 20:30:15,202 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39748, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3286762115456329224_1050, duration: 8176492
2013-10-31 20:30:15,203 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3286762115456329224_1050 size 238055
2013-10-31 20:30:15,203 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3286762115456329224_1050 terminating
2013-10-31 20:30:15,204 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3286762115456329224_1050 size 238055
2013-10-31 20:30:15,205 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar from client DFSClient_848976415
2013-10-31 20:30:15,205 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar is closed by DFSClient_848976415
2013-10-31 20:30:15,206 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3286762115456329224_1050 size 238055
2013-10-31 20:30:15,211 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar. New replication is 10
2013-10-31 20:30:15,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=null
2013-10-31 20:30:15,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,222 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:30:15,227 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:30:15,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:30:15,250 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000002_0'
2013-10-31 20:30:15,251 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000003_0'
2013-10-31 20:30:15,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,576 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split. New replication is 10
2013-10-31 20:30:15,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=null
2013-10-31 20:30:15,583 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split. blk_7708920851468258260_1051
2013-10-31 20:30:15,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7708920851468258260_1051 src: /127.0.0.1:44043 dest: /127.0.0.1:33202
2013-10-31 20:30:15,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7708920851468258260_1051 src: /127.0.0.1:39752 dest: /127.0.0.1:46399
2013-10-31 20:30:15,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7708920851468258260_1051 src: /127.0.0.1:34263 dest: /127.0.0.1:37249
2013-10-31 20:30:15,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7708920851468258260_1051 src: /127.0.0.1:35660 dest: /127.0.0.1:49827
2013-10-31 20:30:15,594 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35660, dest: /127.0.0.1:49827, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7708920851468258260_1051, duration: 874865
2013-10-31 20:30:15,595 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7708920851468258260_1051 terminating
2013-10-31 20:30:15,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34263, dest: /127.0.0.1:37249, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7708920851468258260_1051, duration: 2481644
2013-10-31 20:30:15,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7708920851468258260_1051 terminating
2013-10-31 20:30:15,597 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39752, dest: /127.0.0.1:46399, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7708920851468258260_1051, duration: 3882552
2013-10-31 20:30:15,598 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7708920851468258260_1051 terminating
2013-10-31 20:30:15,599 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44043, dest: /127.0.0.1:33202, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7708920851468258260_1051, duration: 5506761
2013-10-31 20:30:15,599 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7708920851468258260_1051 size 1403
2013-10-31 20:30:15,599 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7708920851468258260_1051 terminating
2013-10-31 20:30:15,601 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7708920851468258260_1051 size 1403
2013-10-31 20:30:15,602 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split from client DFSClient_848976415
2013-10-31 20:30:15,602 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split is closed by DFSClient_848976415
2013-10-31 20:30:15,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7708920851468258260_1051 size 1403
2013-10-31 20:30:15,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7708920851468258260_1051 size 1403
2013-10-31 20:30:15,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,621 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.splitmetainfo. blk_-4574790141223885316_1052
2013-10-31 20:30:15,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4574790141223885316_1052 src: /127.0.0.1:44047 dest: /127.0.0.1:33202
2013-10-31 20:30:15,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4574790141223885316_1052 src: /127.0.0.1:39756 dest: /127.0.0.1:46399
2013-10-31 20:30:15,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4574790141223885316_1052 src: /127.0.0.1:34267 dest: /127.0.0.1:37249
2013-10-31 20:30:15,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34267, dest: /127.0.0.1:37249, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4574790141223885316_1052, duration: 1583714
2013-10-31 20:30:15,632 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4574790141223885316_1052 terminating
2013-10-31 20:30:15,633 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39756, dest: /127.0.0.1:46399, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4574790141223885316_1052, duration: 4870002
2013-10-31 20:30:15,633 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4574790141223885316_1052 size 156
2013-10-31 20:30:15,634 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4574790141223885316_1052 terminating
2013-10-31 20:30:15,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4574790141223885316_1052 size 156
2013-10-31 20:30:15,635 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44047, dest: /127.0.0.1:33202, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4574790141223885316_1052, duration: 6795803
2013-10-31 20:30:15,636 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4574790141223885316_1052 size 156
2013-10-31 20:30:15,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4574790141223885316_1052 terminating
2013-10-31 20:30:15,639 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:30:15,639 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:30:15,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,669 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml. blk_-6826955743783708016_1053
2013-10-31 20:30:15,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6826955743783708016_1053 src: /127.0.0.1:35664 dest: /127.0.0.1:49827
2013-10-31 20:30:15,672 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6826955743783708016_1053 src: /127.0.0.1:39759 dest: /127.0.0.1:46399
2013-10-31 20:30:15,674 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6826955743783708016_1053 src: /127.0.0.1:44052 dest: /127.0.0.1:33202
2013-10-31 20:30:15,678 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44052, dest: /127.0.0.1:33202, bytes: 28315, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6826955743783708016_1053, duration: 1074044
2013-10-31 20:30:15,678 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6826955743783708016_1053 terminating
2013-10-31 20:30:15,679 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39759, dest: /127.0.0.1:46399, bytes: 28315, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6826955743783708016_1053, duration: 2590336
2013-10-31 20:30:15,680 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6826955743783708016_1053 terminating
2013-10-31 20:30:15,681 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35664, dest: /127.0.0.1:49827, bytes: 28315, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-6826955743783708016_1053, duration: 4634976
2013-10-31 20:30:15,681 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-6826955743783708016_1053 size 28315
2013-10-31 20:30:15,682 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6826955743783708016_1053 terminating
2013-10-31 20:30:15,685 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-6826955743783708016_1053 size 28315
2013-10-31 20:30:15,686 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml from client DFSClient_848976415
2013-10-31 20:30:15,686 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml is closed by DFSClient_848976415
2013-10-31 20:30:15,687 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-6826955743783708016_1053 size 28315
2013-10-31 20:30:15,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=null
2013-10-31 20:30:15,703 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44054, bytes: 28539, op: HDFS_READ, cliID: DFSClient_41407361, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6826955743783708016_1053, duration: 476548
2013-10-31 20:30:15,715 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0006: nMaps=4 nReduces=1 max=-1
2013-10-31 20:30:15,715 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0006 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:30:15,715 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0006
2013-10-31 20:30:15,716 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0006 RESULT=SUCCESS
2013-10-31 20:30:15,716 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0006
2013-10-31 20:30:15,717 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031202710049_0006
2013-10-31 20:30:15,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_1383251415692_hadoop_%5B4F35D929D4A7491982C451965D3A5D8E%2FBFF8266866B040D2 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,736 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_conf.xml. blk_1530598995760631944_1055
2013-10-31 20:30:15,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1530598995760631944_1055 src: /127.0.0.1:34273 dest: /127.0.0.1:37249
2013-10-31 20:30:15,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1530598995760631944_1055 src: /127.0.0.1:44056 dest: /127.0.0.1:33202
2013-10-31 20:30:15,740 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1530598995760631944_1055 src: /127.0.0.1:39765 dest: /127.0.0.1:46399
2013-10-31 20:30:15,744 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39765, dest: /127.0.0.1:46399, bytes: 28380, op: HDFS_WRITE, cliID: DFSClient_41407361, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_1530598995760631944_1055, duration: 745128
2013-10-31 20:30:15,744 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1530598995760631944_1055 terminating
2013-10-31 20:30:15,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44056, dest: /127.0.0.1:33202, bytes: 28380, op: HDFS_WRITE, cliID: DFSClient_41407361, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1530598995760631944_1055, duration: 2299467
2013-10-31 20:30:15,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1530598995760631944_1055 terminating
2013-10-31 20:30:15,746 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_1530598995760631944_1055 size 28380
2013-10-31 20:30:15,746 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34273, dest: /127.0.0.1:37249, bytes: 28380, op: HDFS_WRITE, cliID: DFSClient_41407361, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1530598995760631944_1055, duration: 2986894
2013-10-31 20:30:15,746 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1530598995760631944_1055 terminating
2013-10-31 20:30:15,748 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_1530598995760631944_1055 size 28380
2013-10-31 20:30:15,748 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_conf.xml from client DFSClient_41407361
2013-10-31 20:30:15,748 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_conf.xml is closed by DFSClient_41407361
2013-10-31 20:30:15,749 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_1530598995760631944_1055 size 28380
2013-10-31 20:30:15,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:15,767 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken. blk_1905784073861442021_1056
2013-10-31 20:30:15,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1905784073861442021_1056 src: /127.0.0.1:35672 dest: /127.0.0.1:49827
2013-10-31 20:30:15,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1905784073861442021_1056 src: /127.0.0.1:44059 dest: /127.0.0.1:33202
2013-10-31 20:30:15,772 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1905784073861442021_1056 src: /127.0.0.1:34278 dest: /127.0.0.1:37249
2013-10-31 20:30:15,779 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34278, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1905784073861442021_1056, duration: 2361021
2013-10-31 20:30:15,780 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1905784073861442021_1056 terminating
2013-10-31 20:30:15,780 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44059, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1905784073861442021_1056, duration: 3124124
2013-10-31 20:30:15,781 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1905784073861442021_1056 terminating
2013-10-31 20:30:15,781 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_1905784073861442021_1056 size 116
2013-10-31 20:30:15,781 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35672, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1905784073861442021_1056, duration: 4067430
2013-10-31 20:30:15,782 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1905784073861442021_1056 terminating
2013-10-31 20:30:15,782 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_1905784073861442021_1056 size 116
2013-10-31 20:30:15,785 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken from client DFSClient_848976415
2013-10-31 20:30:15,785 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken is closed by DFSClient_848976415
2013-10-31 20:30:15,786 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_1905784073861442021_1056 size 116
2013-10-31 20:30:15,791 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken
2013-10-31 20:30:15,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.splitmetainfo dst=null perm=null
2013-10-31 20:30:15,796 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39769, bytes: 160, op: HDFS_READ, cliID: DFSClient_41407361, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4574790141223885316_1052, duration: 277284
2013-10-31 20:30:15,797 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0006 = 1449. Number of splits = 4
2013-10-31 20:30:15,797 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,798 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,798 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,798 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,799 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,799 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,799 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,799 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,800 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,800 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,800 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,801 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:15,801 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0006 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:30:15,802 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0006 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 20:30:15,996 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0006_m_000005_0' to tip task_20131031202710049_0006_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:30:16,000 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000004_0'
2013-10-31 20:30:16,001 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0005_m_000005_0'
2013-10-31 20:30:16,002 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_m_000005_0 task's state:UNASSIGNED
2013-10-31 20:30:16,003 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_m_000005_0 which needs 1 slots
2013-10-31 20:30:16,003 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_m_000005_0 which needs 1 slots
2013-10-31 20:30:16,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken dst=null perm=null
2013-10-31 20:30:16,012 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44062, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1905784073861442021_1056, duration: 270787
2013-10-31 20:30:16,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=null
2013-10-31 20:30:16,025 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44064, bytes: 28539, op: HDFS_READ, cliID: DFSClient_82586894, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6826955743783708016_1053, duration: 402702
2013-10-31 20:30:16,060 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:30:16,065 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8057071573712851591_1043 file build/test/data/dfs/data/data7/current/blk_-8057071573712851591 for deletion
2013-10-31 20:30:16,066 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8057071573712851591_1043 at file build/test/data/dfs/data/data7/current/blk_-8057071573712851591
2013-10-31 20:30:16,066 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5661487864929242591_1041 file build/test/data/dfs/data/data7/current/blk_-5661487864929242591 for deletion
2013-10-31 20:30:16,066 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3050374350235301105_1042 file build/test/data/dfs/data/data8/current/blk_3050374350235301105 for deletion
2013-10-31 20:30:16,066 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5661487864929242591_1041 at file build/test/data/dfs/data/data7/current/blk_-5661487864929242591
2013-10-31 20:30:16,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3050374350235301105_1042 at file build/test/data/dfs/data/data8/current/blk_3050374350235301105
2013-10-31 20:30:16,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6049188892739496679_1044 file build/test/data/dfs/data/data8/current/blk_6049188892739496679 for deletion
2013-10-31 20:30:16,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6049188892739496679_1044 at file build/test/data/dfs/data/data8/current/blk_6049188892739496679
2013-10-31 20:30:16,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=null
2013-10-31 20:30:16,089 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35679, bytes: 239915, op: HDFS_READ, cliID: DFSClient_82586894, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3286762115456329224_1050, duration: 1667983
2013-10-31 20:30:16,193 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031202710049_0005_m_583226979
2013-10-31 20:30:16,200 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27379 with signal TERM. Exit code 0
2013-10-31 20:30:16,200 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0006_m_699960213
2013-10-31 20:30:16,200 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0006_m_699960213 spawned.
2013-10-31 20:30:16,202 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0006/attempt_20131031202710049_0006_m_000005_0/taskjvm.sh
2013-10-31 20:30:16,413 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:33202 to replicate blk_3286762115456329224_1050 to datanode(s) 127.0.0.1:37249
2013-10-31 20:30:16,413 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_4103253142703256918_1047
2013-10-31 20:30:16,413 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_4103253142703256918_1047
2013-10-31 20:30:16,801 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0005
2013-10-31 20:30:16,802 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0005 being deleted.
2013-10-31 20:30:16,807 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:16,807 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:16,807 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:16,808 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_m_583226979 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:17,565 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_m_699960213 given task: attempt_20131031202710049_0006_m_000005_0
2013-10-31 20:30:18,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:18,241 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909) Starting thread to transfer block blk_3286762115456329224_1050 to 127.0.0.1:37249
2013-10-31 20:30:18,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3286762115456329224_1050 src: /127.0.0.1:34286 dest: /127.0.0.1:37249
2013-10-31 20:30:18,243 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909):Transmitted block blk_3286762115456329224_1050 to /127.0.0.1:37249
2013-10-31 20:30:18,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3286762115456329224_1050 src: /127.0.0.1:34286 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:30:18,250 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3286762115456329224_1050 size 238055
2013-10-31 20:30:18,685 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4103253142703256918_1047 file build/test/data/dfs/data/data5/current/blk_4103253142703256918 for deletion
2013-10-31 20:30:18,685 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4103253142703256918_1047 at file build/test/data/dfs/data/data5/current/blk_4103253142703256918
2013-10-31 20:30:19,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4103253142703256918_1047 file build/test/data/dfs/data/data7/current/blk_4103253142703256918 for deletion
2013-10-31 20:30:19,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4103253142703256918_1047 at file build/test/data/dfs/data/data7/current/blk_4103253142703256918
2013-10-31 20:30:19,414 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_4103253142703256918_1047
2013-10-31 20:30:20,040 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0005
2013-10-31 20:30:20,041 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0005_m_000006_0 not found in cache
2013-10-31 20:30:20,042 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0005 for user-log deletion with retainTimeStamp:1383337820042
2013-10-31 20:30:20,138 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0005_r_322169434 since job job_20131031202710049_0005 is dead
2013-10-31 20:30:20,149 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27530 with signal TERM. Exit code 0
2013-10-31 20:30:20,251 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0005
2013-10-31 20:30:20,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0005 for user-log deletion with retainTimeStamp:1383337820252
2013-10-31 20:30:20,335 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:20,335 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:20,335 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:20,335 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_r_322169434 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:20,349 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0005_m_-51669306 since job job_20131031202710049_0005 is dead
2013-10-31 20:30:20,357 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27170 with signal TERM. Exit code 0
2013-10-31 20:30:20,467 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0005_m_1094366995 since job job_20131031202710049_0005 is dead
2013-10-31 20:30:20,472 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27262 with signal TERM. Exit code 0
2013-10-31 20:30:20,505 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0005_m_-658343481 since job job_20131031202710049_0005 is dead
2013-10-31 20:30:20,513 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27232 with signal TERM. Exit code 0
2013-10-31 20:30:20,552 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:20,553 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:20,553 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:20,553 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_m_-51669306 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:20,659 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:20,659 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:20,659 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:20,659 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_m_1094366995 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:20,723 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:20,724 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:20,724 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:20,724 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_m_-658343481 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:20,795 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4103253142703256918_1047 file build/test/data/dfs/data/data2/current/blk_4103253142703256918 for deletion
2013-10-31 20:30:20,796 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4103253142703256918_1047 at file build/test/data/dfs/data/data2/current/blk_4103253142703256918
2013-10-31 20:30:20,870 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0005_m_-579525522 since job job_20131031202710049_0005 is dead
2013-10-31 20:30:20,879 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27062 with signal TERM. Exit code 0
2013-10-31 20:30:20,991 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000005_0 0.0% setup
2013-10-31 20:30:20,993 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_m_000005_0 is done.
2013-10-31 20:30:20,993 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_m_000005_0 was -1
2013-10-31 20:30:20,994 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:21,003 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0005
2013-10-31 20:30:21,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0005 for user-log deletion with retainTimeStamp:1383337821004
2013-10-31 20:30:21,074 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:21,075 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:21,075 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:21,075 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_m_-579525522 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 20:30:21,310 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0005_m_-218308890 since job job_20131031202710049_0005 is dead
2013-10-31 20:30:21,320 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27344 with signal TERM. Exit code 0
2013-10-31 20:30:21,874 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:21,874 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:21,874 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:21,874 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0005_m_-218308890 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:22,007 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_m_000005_0' has completed task_20131031202710049_0006_m_000005 successfully.
2013-10-31 20:30:22,009 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0006_m_000000_0' to tip task_20131031202710049_0006_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:30:22,010 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0006_m_000000
2013-10-31 20:30:22,011 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:30:22,011 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_m_000000_0 which needs 1 slots
2013-10-31 20:30:22,011 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_m_000000_0 which needs 1 slots
2013-10-31 20:30:22,041 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0006_m_1968776560
2013-10-31 20:30:22,041 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0006_m_1968776560 spawned.
2013-10-31 20:30:22,044 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0006/attempt_20131031202710049_0006_m_000000_0/taskjvm.sh
2013-10-31 20:30:22,809 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0006_m_000001_0' to tip task_20131031202710049_0006_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:30:22,810 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0006_m_000001
2013-10-31 20:30:22,811 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:30:22,811 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_m_000001_0 which needs 1 slots
2013-10-31 20:30:22,812 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_m_000001_0 which needs 1 slots
2013-10-31 20:30:22,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken dst=null perm=null
2013-10-31 20:30:22,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34288, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1905784073861442021_1056, duration: 146303
2013-10-31 20:30:22,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=null
2013-10-31 20:30:22,825 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44072, bytes: 28539, op: HDFS_READ, cliID: DFSClient_-2047703504, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6826955743783708016_1053, duration: 161329
2013-10-31 20:30:22,838 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:30:22,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=null
2013-10-31 20:30:22,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35687, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2047703504, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3286762115456329224_1050, duration: 737661
2013-10-31 20:30:22,909 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0006_m_1263659617
2013-10-31 20:30:22,910 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0006_m_1263659617 spawned.
2013-10-31 20:30:22,911 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0006/attempt_20131031202710049_0006_m_000001_0/taskjvm.sh
2013-10-31 20:30:22,921 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_m_1968776560 given task: attempt_20131031202710049_0006_m_000000_0
2013-10-31 20:30:23,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=null
2013-10-31 20:30:23,486 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35690, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7708920851468258260_1051, duration: 183234
2013-10-31 20:30:23,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:30:23,526 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44077, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000000_0, offset: 1024, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 125427
2013-10-31 20:30:23,876 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_m_1263659617 given task: attempt_20131031202710049_0006_m_000001_0
2013-10-31 20:30:24,048 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0006_m_000002_0' to tip task_20131031202710049_0006_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:30:24,048 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0006_m_000002
2013-10-31 20:30:24,049 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:30:24,049 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_m_000002_0 which needs 1 slots
2013-10-31 20:30:24,049 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_m_000002_0 which needs 1 slots
2013-10-31 20:30:24,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken dst=null perm=null
2013-10-31 20:30:24,053 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44079, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1905784073861442021_1056, duration: 129662
2013-10-31 20:30:24,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=null
2013-10-31 20:30:24,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39789, bytes: 28539, op: HDFS_READ, cliID: DFSClient_150934967, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6826955743783708016_1053, duration: 184336
2013-10-31 20:30:24,072 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:30:24,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=null
2013-10-31 20:30:24,099 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44082, bytes: 239915, op: HDFS_READ, cliID: DFSClient_150934967, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3286762115456329224_1050, duration: 770991
2013-10-31 20:30:24,155 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0006_m_1769982779
2013-10-31 20:30:24,155 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0006_m_1769982779 spawned.
2013-10-31 20:30:24,156 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0006/attempt_20131031202710049_0006_m_000002_0/taskjvm.sh
2013-10-31 20:30:24,261 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0006_m_000003_0' to tip task_20131031202710049_0006_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:30:24,262 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0006_m_000003
2013-10-31 20:30:24,264 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:30:24,264 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_m_000003_0 which needs 1 slots
2013-10-31 20:30:24,264 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_m_000003_0 which needs 1 slots
2013-10-31 20:30:24,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006/jobToken dst=null perm=null
2013-10-31 20:30:24,275 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44083, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1905784073861442021_1056, duration: 285060
2013-10-31 20:30:24,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.xml dst=null perm=null
2013-10-31 20:30:24,287 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35699, bytes: 28539, op: HDFS_READ, cliID: DFSClient_915770415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-6826955743783708016_1053, duration: 394770
2013-10-31 20:30:24,321 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:30:24,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.jar dst=null perm=null
2013-10-31 20:30:24,343 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39794, bytes: 239915, op: HDFS_READ, cliID: DFSClient_915770415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3286762115456329224_1050, duration: 754732
2013-10-31 20:30:24,398 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0006_m_-1165563184
2013-10-31 20:30:24,399 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0006_m_-1165563184 spawned.
2013-10-31 20:30:24,400 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0006/attempt_20131031202710049_0006_m_000003_0/taskjvm.sh
2013-10-31 20:30:24,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=null
2013-10-31 20:30:24,597 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39796, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7708920851468258260_1051, duration: 171921
2013-10-31 20:30:24,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:30:24,884 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44089, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 177227
2013-10-31 20:30:25,239 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_m_1769982779 given task: attempt_20131031202710049_0006_m_000002_0
2013-10-31 20:30:25,601 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_m_-1165563184 given task: attempt_20131031202710049_0006_m_000003_0
2013-10-31 20:30:25,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=null
2013-10-31 20:30:25,751 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35707, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000002_0, offset: 512, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7708920851468258260_1051, duration: 215483
2013-10-31 20:30:25,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:30:25,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44094, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000002_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 160195
2013-10-31 20:30:26,001 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 96 raw values into 1 aggregated values, total 18
2013-10-31 20:30:26,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006/job.split dst=null perm=null
2013-10-31 20:30:26,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39804, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000003_0, offset: 1024, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7708920851468258260_1051, duration: 130314
2013-10-31 20:30:26,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:30:26,140 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34315, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0006_m_000003_0, offset: 512, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3037311813710157570_1002, duration: 360745
2013-10-31 20:30:26,412 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 20:30:26,413 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_m_000000_0 is done.
2013-10-31 20:30:26,413 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_m_000000_0 was 76
2013-10-31 20:30:26,413 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:27,011 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0006_m_000005_0
2013-10-31 20:30:27,012 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0006_m_000005_0
2013-10-31 20:30:27,012 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0006_m_000005_0 not found in cache
2013-10-31 20:30:27,524 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 20:30:27,527 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_m_000001_0 is done.
2013-10-31 20:30:27,528 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_m_000001_0 was 106
2013-10-31 20:30:27,528 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:28,016 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_m_000000_0' has completed task_20131031202710049_0006_m_000000 successfully.
2013-10-31 20:30:28,019 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0006_r_000000_0' to tip task_20131031202710049_0006_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:30:28,020 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:30:28,021 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_r_000000_0 which needs 1 slots
2013-10-31 20:30:28,021 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_r_000000_0 which needs 1 slots
2013-10-31 20:30:28,040 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0006_r_-459265034
2013-10-31 20:30:28,041 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0006_r_-459265034 spawned.
2013-10-31 20:30:28,044 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0006/attempt_20131031202710049_0006_r_000000_0/taskjvm.sh
2013-10-31 20:30:28,681 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000002_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 20:30:28,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_m_000002_0 is done.
2013-10-31 20:30:28,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_m_000002_0 was 106
2013-10-31 20:30:28,684 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:28,817 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_m_000001_0' has completed task_20131031202710049_0006_m_000001 successfully.
2013-10-31 20:30:29,021 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000003_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 20:30:29,024 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_m_000003_0 is done.
2013-10-31 20:30:29,024 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_m_000003_0 was 75
2013-10-31 20:30:29,024 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:30,053 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_m_000002_0' has completed task_20131031202710049_0006_m_000002 successfully.
2013-10-31 20:30:30,115 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_r_-459265034 given task: attempt_20131031202710049_0006_r_000000_0
2013-10-31 20:30:30,270 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_m_000003_0' has completed task_20131031202710049_0006_m_000003 successfully.
2013-10-31 20:30:30,633 INFO mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031202710049_0006_r_000000_0 is 2614 ms debug.
2013-10-31 20:30:35,845 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:52987, bytes: 76, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0006_m_000000_0, duration: 7001120
2013-10-31 20:30:35,864 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53362, bytes: 106, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0006_m_000001_0, duration: 12305767
2013-10-31 20:30:35,881 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53655, bytes: 106, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0006_m_000002_0, duration: 12734595
2013-10-31 20:30:35,899 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:45386, bytes: 75, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0006_m_000003_0, duration: 13278284
2013-10-31 20:30:36,643 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:30:36,718 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:30:36,772 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:30:37,029 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031202710049_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:30:37,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:37,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:37,138 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0/part-00000. blk_3287974640251260030_1057
2013-10-31 20:30:37,161 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3287974640251260030_1057 src: /127.0.0.1:35721 dest: /127.0.0.1:49827
2013-10-31 20:30:37,163 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3287974640251260030_1057 src: /127.0.0.1:44108 dest: /127.0.0.1:33202
2013-10-31 20:30:37,164 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3287974640251260030_1057 src: /127.0.0.1:39817 dest: /127.0.0.1:46399
2013-10-31 20:30:37,169 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39817, dest: /127.0.0.1:46399, bytes: 299, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0006_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3287974640251260030_1057, duration: 2802672
2013-10-31 20:30:37,171 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3287974640251260030_1057 terminating
2013-10-31 20:30:37,173 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3287974640251260030_1057 size 299
2013-10-31 20:30:37,173 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44108, dest: /127.0.0.1:33202, bytes: 299, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0006_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3287974640251260030_1057, duration: 7733182
2013-10-31 20:30:37,174 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3287974640251260030_1057 terminating
2013-10-31 20:30:37,175 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35721, dest: /127.0.0.1:49827, bytes: 299, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0006_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3287974640251260030_1057, duration: 9115409
2013-10-31 20:30:37,175 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3287974640251260030_1057 terminating
2013-10-31 20:30:37,179 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3287974640251260030_1057 size 299
2013-10-31 20:30:37,179 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3287974640251260030_1057 size 299
2013-10-31 20:30:37,181 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0006_r_000000_0
2013-10-31 20:30:37,181 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0006_r_000000_0
2013-10-31 20:30:37,232 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0006_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:30:37,233 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:30:39,705 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 20:30:40,033 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0006_r_000000_0
2013-10-31 20:30:40,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0 dst=null perm=null
2013-10-31 20:30:40,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:40,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:40,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary/_attempt_20131031202710049_0006_r_000000_0 dst=null perm=null
2013-10-31 20:30:42,749 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 20:30:42,751 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 20:30:42,752 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_r_000000_0 is done.
2013-10-31 20:30:42,752 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_r_000000_0 was -1
2013-10-31 20:30:42,753 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:43,037 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_r_000000_0' has completed task_20131031202710049_0006_r_000000 successfully.
2013-10-31 20:30:43,041 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0006_m_000004_0' to tip task_20131031202710049_0006_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:30:43,044 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0006_m_000004_0 task's state:UNASSIGNED
2013-10-31 20:30:43,044 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0006_m_000004_0 which needs 1 slots
2013-10-31 20:30:43,044 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0006_m_000004_0 which needs 1 slots
2013-10-31 20:30:43,078 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0006/attempt_20131031202710049_0006_m_000004_0. Attempting to reuse: jvm_20131031202710049_0006_m_699960213
2013-10-31 20:30:44,062 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0006_m_699960213 given task: attempt_20131031202710049_0006_m_000004_0
2013-10-31 20:30:44,170 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000004_0 0.0%
2013-10-31 20:30:44,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary dst=null perm=null
2013-10-31 20:30:44,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:44,199 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_SUCCESS from client DFSClient_attempt_20131031202710049_0006_m_000004_0
2013-10-31 20:30:44,199 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0006_m_000004_0
2013-10-31 20:30:44,206 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3286762115456329224 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:44,206 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3286762115456329224 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:44,207 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3286762115456329224 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:44,207 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3286762115456329224 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:44,207 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7708920851468258260 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:44,207 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7708920851468258260 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:44,208 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7708920851468258260 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:44,208 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7708920851468258260 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:44,208 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4574790141223885316 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:44,208 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4574790141223885316 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:44,209 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4574790141223885316 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:44,209 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6826955743783708016 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:44,209 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6826955743783708016 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:44,209 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6826955743783708016 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:30:44,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0006 dst=null perm=null
2013-10-31 20:30:46,418 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-4574790141223885316_1052 blk_-6826955743783708016_1053 blk_3286762115456329224_1050 blk_7708920851468258260_1051
2013-10-31 20:30:46,419 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-4574790141223885316_1052 blk_-6826955743783708016_1053 blk_3286762115456329224_1050 blk_7708920851468258260_1051
2013-10-31 20:30:47,142 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0006_m_000004_0 0.0% cleanup
2013-10-31 20:30:47,144 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0006_m_000004_0 is done.
2013-10-31 20:30:47,144 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0006_m_000004_0 was -1
2013-10-31 20:30:47,145 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:48,044 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0006_r_000000_0
2013-10-31 20:30:48,045 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0006_r_000000_0
2013-10-31 20:30:48,251 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6826955743783708016_1053 file build/test/data/dfs/data/data3/current/blk_-6826955743783708016 for deletion
2013-10-31 20:30:48,251 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4574790141223885316_1052 file build/test/data/dfs/data/data4/current/blk_-4574790141223885316 for deletion
2013-10-31 20:30:48,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3286762115456329224_1050 file build/test/data/dfs/data/data4/current/blk_3286762115456329224 for deletion
2013-10-31 20:30:48,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4574790141223885316_1052 at file build/test/data/dfs/data/data4/current/blk_-4574790141223885316
2013-10-31 20:30:48,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6826955743783708016_1053 at file build/test/data/dfs/data/data3/current/blk_-6826955743783708016
2013-10-31 20:30:48,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3286762115456329224_1050 at file build/test/data/dfs/data/data4/current/blk_3286762115456329224
2013-10-31 20:30:48,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7708920851468258260_1051 file build/test/data/dfs/data/data3/current/blk_7708920851468258260 for deletion
2013-10-31 20:30:48,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7708920851468258260_1051 at file build/test/data/dfs/data/data3/current/blk_7708920851468258260
2013-10-31 20:30:48,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6826955743783708016_1053 file build/test/data/dfs/data/data5/current/blk_-6826955743783708016 for deletion
2013-10-31 20:30:48,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4574790141223885316_1052 file build/test/data/dfs/data/data6/current/blk_-4574790141223885316 for deletion
2013-10-31 20:30:48,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6826955743783708016_1053 at file build/test/data/dfs/data/data5/current/blk_-6826955743783708016
2013-10-31 20:30:48,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3286762115456329224_1050 file build/test/data/dfs/data/data6/current/blk_3286762115456329224 for deletion
2013-10-31 20:30:48,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4574790141223885316_1052 at file build/test/data/dfs/data/data6/current/blk_-4574790141223885316
2013-10-31 20:30:48,696 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7708920851468258260_1051 file build/test/data/dfs/data/data5/current/blk_7708920851468258260 for deletion
2013-10-31 20:30:48,696 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3286762115456329224_1050 at file build/test/data/dfs/data/data6/current/blk_3286762115456329224
2013-10-31 20:30:48,696 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7708920851468258260_1051 at file build/test/data/dfs/data/data5/current/blk_7708920851468258260
2013-10-31 20:30:49,052 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0006_m_000004_0' has completed task_20131031202710049_0006_m_000004 successfully.
2013-10-31 20:30:49,053 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0006 has completed successfully.
2013-10-31 20:30:49,054 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0006,submitTime=1383251415692,launchTime=1383251415801,firstMapTaskLaunchTime=1383251422009,firstReduceTaskLaunchTime=1383251428018,firstJobSetupTaskLaunchTime=1383251415995,firstJobCleanupTaskLaunchTime=1383251443041,finishTime=1383251449053,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=14,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[4F35D929D4A7491982C451965D3A5D8E/BFF8266866B040D296E01EF50ED85212] test/(1/1) ...dpipesplatform/bigdecimal
2013-10-31 20:30:49,062 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_1383251415692_hadoop_%5B4F35D929D4A7491982C451965D3A5D8E%2FBFF8266866B040D2. blk_-5993270457941517461_1058
2013-10-31 20:30:49,066 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5993270457941517461_1058 src: /127.0.0.1:39821 dest: /127.0.0.1:46399
2013-10-31 20:30:49,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5993270457941517461_1058 src: /127.0.0.1:34332 dest: /127.0.0.1:37249
2013-10-31 20:30:49,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5993270457941517461_1058 src: /127.0.0.1:35729 dest: /127.0.0.1:49827
2013-10-31 20:30:49,081 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35729, dest: /127.0.0.1:49827, bytes: 28321, op: HDFS_WRITE, cliID: DFSClient_41407361, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5993270457941517461_1058, duration: 7129677
2013-10-31 20:30:49,082 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5993270457941517461_1058 terminating
2013-10-31 20:30:49,084 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34332, dest: /127.0.0.1:37249, bytes: 28321, op: HDFS_WRITE, cliID: DFSClient_41407361, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-5993270457941517461_1058, duration: 6712185
2013-10-31 20:30:49,087 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5993270457941517461_1058 size 28321
2013-10-31 20:30:49,087 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5993270457941517461_1058 terminating
2013-10-31 20:30:49,088 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39821, dest: /127.0.0.1:46399, bytes: 28321, op: HDFS_WRITE, cliID: DFSClient_41407361, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-5993270457941517461_1058, duration: 13793102
2013-10-31 20:30:49,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-5993270457941517461_1058 size 28321
2013-10-31 20:30:49,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5993270457941517461_1058 terminating
2013-10-31 20:30:49,093 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-5993270457941517461_1058 size 28321
2013-10-31 20:30:49,094 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_1383251415692_hadoop_%5B4F35D929D4A7491982C451965D3A5D8E%2FBFF8266866B040D2 from client DFSClient_41407361
2013-10-31 20:30:49,095 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_logs/history/job_20131031202710049_0006_1383251415692_hadoop_%5B4F35D929D4A7491982C451965D3A5D8E%2FBFF8266866B040D2 is closed by DFSClient_41407361
2013-10-31 20:30:49,103 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0006_1383251415692_hadoop_%5B4F35D929D4A7491982C451965D3A5D8E%2FBFF8266866B040D2 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:30:49,104 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_m_000000_0'
2013-10-31 20:30:49,104 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_m_000004_0'
2013-10-31 20:30:49,105 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_m_000005_0'
2013-10-31 20:30:49,105 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_r_000000_0'
2013-10-31 20:30:49,105 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1905784073861442021 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:30:49,106 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1905784073861442021 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:30:49,106 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1905784073861442021 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:30:49,113 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0006_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:30:49,114 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/_temporary
2013-10-31 20:30:49,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0006 dst=null perm=null
2013-10-31 20:30:49,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal dst=null perm=null
2013-10-31 20:30:49,171 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:30:49,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/part-00000 dst=null perm=null
2013-10-31 20:30:49,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/part-00000 dst=null perm=null
2013-10-31 20:30:49,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44117, bytes: 303, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3287974640251260030_1057, duration: 336340
2013-10-31 20:30:49,177 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/bigdecimal
2013-10-31 20:30:49,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal dst=null perm=null
2013-10-31 20:30:49,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/bigdecimal/part-00000 dst=null perm=null
2013-10-31 20:30:49,181 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44118, bytes: 303, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3287974640251260030_1057, duration: 138021
2013-10-31 20:30:49,191 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:30:49,191 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:30:49,221 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:30:49,221 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:30:49,222 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:30:49,222 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false"]
2013-10-31 20:30:49,223 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:30:49,223 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:30:49,223 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:30:49,224 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:30:49,228 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:30:49,229 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:30:49,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:49,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:30:49,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:49,244 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar. blk_-4734428612678706897_1059
2013-10-31 20:30:49,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4734428612678706897_1059 src: /127.0.0.1:39827 dest: /127.0.0.1:46399
2013-10-31 20:30:49,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4734428612678706897_1059 src: /127.0.0.1:35734 dest: /127.0.0.1:49827
2013-10-31 20:30:49,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4734428612678706897_1059 src: /127.0.0.1:44121 dest: /127.0.0.1:33202
2013-10-31 20:30:49,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44121, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4734428612678706897_1059, duration: 4535445
2013-10-31 20:30:49,256 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4734428612678706897_1059 terminating
2013-10-31 20:30:49,257 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4734428612678706897_1059 size 238055
2013-10-31 20:30:49,258 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35734, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4734428612678706897_1059, duration: 6391544
2013-10-31 20:30:49,258 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4734428612678706897_1059 terminating
2013-10-31 20:30:49,260 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39827, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4734428612678706897_1059, duration: 8091537
2013-10-31 20:30:49,260 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4734428612678706897_1059 terminating
2013-10-31 20:30:49,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4734428612678706897_1059 size 238055
2013-10-31 20:30:49,263 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar from client DFSClient_848976415
2013-10-31 20:30:49,264 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar is closed by DFSClient_848976415
2013-10-31 20:30:49,264 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4734428612678706897_1059 size 238055
2013-10-31 20:30:49,268 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar. New replication is 10
2013-10-31 20:30:49,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar dst=null perm=null
2013-10-31 20:30:49,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:49,277 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:30:49,283 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:30:49,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:30:49,286 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:30:49,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:30:49,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:49,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:49,303 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split. New replication is 10
2013-10-31 20:30:49,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split dst=null perm=null
2013-10-31 20:30:49,310 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split. blk_6426401666176928517_1060
2013-10-31 20:30:49,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6426401666176928517_1060 src: /127.0.0.1:39830 dest: /127.0.0.1:46399
2013-10-31 20:30:49,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6426401666176928517_1060 src: /127.0.0.1:44123 dest: /127.0.0.1:33202
2013-10-31 20:30:49,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6426401666176928517_1060 src: /127.0.0.1:34342 dest: /127.0.0.1:37249
2013-10-31 20:30:49,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6426401666176928517_1060 src: /127.0.0.1:35739 dest: /127.0.0.1:49827
2013-10-31 20:30:49,321 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35739, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6426401666176928517_1060, duration: 873813
2013-10-31 20:30:49,321 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6426401666176928517_1060 terminating
2013-10-31 20:30:49,322 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34342, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6426401666176928517_1060, duration: 2300860
2013-10-31 20:30:49,323 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6426401666176928517_1060 terminating
2013-10-31 20:30:49,327 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44123, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6426401666176928517_1060, duration: 3994385
2013-10-31 20:30:49,327 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6426401666176928517_1060 size 697
2013-10-31 20:30:49,327 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6426401666176928517_1060 terminating
2013-10-31 20:30:49,329 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6426401666176928517_1060 size 697
2013-10-31 20:30:49,329 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39830, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6426401666176928517_1060, duration: 8780331
2013-10-31 20:30:49,329 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6426401666176928517_1060 size 697
2013-10-31 20:30:49,330 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6426401666176928517_1060 terminating
2013-10-31 20:30:49,332 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6426401666176928517_1060 size 697
2013-10-31 20:30:49,332 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split from client DFSClient_848976415
2013-10-31 20:30:49,333 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split is closed by DFSClient_848976415
2013-10-31 20:30:49,419 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:46399 to replicate blk_-4734428612678706897_1059 to datanode(s) 127.0.0.1:37249
2013-10-31 20:30:49,420 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-6826955743783708016_1053 blk_1905784073861442021_1056 blk_3286762115456329224_1050 blk_7708920851468258260_1051
2013-10-31 20:30:49,420 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-4574790141223885316_1052 blk_1905784073861442021_1056 blk_3286762115456329224_1050 blk_7708920851468258260_1051
2013-10-31 20:30:50,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,062 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.splitmetainfo. blk_4293997882210496524_1061
2013-10-31 20:30:50,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4293997882210496524_1061 src: /127.0.0.1:35740 dest: /127.0.0.1:49827
2013-10-31 20:30:50,063 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4293997882210496524_1061 src: /127.0.0.1:34345 dest: /127.0.0.1:37249
2013-10-31 20:30:50,064 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4293997882210496524_1061 src: /127.0.0.1:39836 dest: /127.0.0.1:46399
2013-10-31 20:30:50,066 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39836, dest: /127.0.0.1:46399, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4293997882210496524_1061, duration: 651896
2013-10-31 20:30:50,066 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4293997882210496524_1061 terminating
2013-10-31 20:30:50,067 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34345, dest: /127.0.0.1:37249, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4293997882210496524_1061, duration: 2079543
2013-10-31 20:30:50,067 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4293997882210496524_1061 terminating
2013-10-31 20:30:50,068 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35740, dest: /127.0.0.1:49827, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4293997882210496524_1061, duration: 3122379
2013-10-31 20:30:50,068 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4293997882210496524_1061 terminating
2013-10-31 20:30:50,070 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_4293997882210496524_1061 size 78
2013-10-31 20:30:50,070 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:30:50,070 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:30:50,070 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_4293997882210496524_1061 size 78
2013-10-31 20:30:50,072 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_4293997882210496524_1061 size 78
2013-10-31 20:30:50,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,091 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml. blk_3746774599525171999_1062
2013-10-31 20:30:50,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3746774599525171999_1062 src: /127.0.0.1:44129 dest: /127.0.0.1:33202
2013-10-31 20:30:50,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3746774599525171999_1062 src: /127.0.0.1:39838 dest: /127.0.0.1:46399
2013-10-31 20:30:50,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3746774599525171999_1062 src: /127.0.0.1:35745 dest: /127.0.0.1:49827
2013-10-31 20:30:50,100 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35745, dest: /127.0.0.1:49827, bytes: 29367, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3746774599525171999_1062, duration: 973576
2013-10-31 20:30:50,100 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3746774599525171999_1062 terminating
2013-10-31 20:30:50,101 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39838, dest: /127.0.0.1:46399, bytes: 29367, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3746774599525171999_1062, duration: 2323113
2013-10-31 20:30:50,102 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3746774599525171999_1062 terminating
2013-10-31 20:30:50,103 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44129, dest: /127.0.0.1:33202, bytes: 29367, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3746774599525171999_1062, duration: 4055719
2013-10-31 20:30:50,103 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3746774599525171999_1062 size 29367
2013-10-31 20:30:50,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3746774599525171999_1062 terminating
2013-10-31 20:30:50,105 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3746774599525171999_1062 size 29367
2013-10-31 20:30:50,106 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml from client DFSClient_848976415
2013-10-31 20:30:50,106 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml is closed by DFSClient_848976415
2013-10-31 20:30:50,108 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3746774599525171999_1062 size 29367
2013-10-31 20:30:50,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml dst=null perm=null
2013-10-31 20:30:50,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44133, bytes: 29599, op: HDFS_READ, cliID: DFSClient_-580687144, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3746774599525171999_1062, duration: 387759
2013-10-31 20:30:50,142 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0007: nMaps=2 nReduces=1 max=-1
2013-10-31 20:30:50,142 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0007 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:30:50,143 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0007
2013-10-31 20:30:50,143 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0007 RESULT=SUCCESS
2013-10-31 20:30:50,143 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0007
2013-10-31 20:30:50,145 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0007
2013-10-31 20:30:50,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_1383251450111_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2F3639498DF8354826 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,178 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_conf.xml. blk_4500649980417596560_1064
2013-10-31 20:30:50,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4500649980417596560_1064 src: /127.0.0.1:35748 dest: /127.0.0.1:49827
2013-10-31 20:30:50,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4500649980417596560_1064 src: /127.0.0.1:39843 dest: /127.0.0.1:46399
2013-10-31 20:30:50,183 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4500649980417596560_1064 src: /127.0.0.1:44136 dest: /127.0.0.1:33202
2013-10-31 20:30:50,189 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44136, dest: /127.0.0.1:33202, bytes: 29432, op: HDFS_WRITE, cliID: DFSClient_-580687144, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4500649980417596560_1064, duration: 1593347
2013-10-31 20:30:50,189 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4500649980417596560_1064 terminating
2013-10-31 20:30:50,191 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39843, dest: /127.0.0.1:46399, bytes: 29432, op: HDFS_WRITE, cliID: DFSClient_-580687144, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4500649980417596560_1064, duration: 4216396
2013-10-31 20:30:50,191 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4500649980417596560_1064 terminating
2013-10-31 20:30:50,193 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_4500649980417596560_1064 size 29432
2013-10-31 20:30:50,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35748, dest: /127.0.0.1:49827, bytes: 29432, op: HDFS_WRITE, cliID: DFSClient_-580687144, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4500649980417596560_1064, duration: 5816339
2013-10-31 20:30:50,193 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_4500649980417596560_1064 size 29432
2013-10-31 20:30:50,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4500649980417596560_1064 terminating
2013-10-31 20:30:50,196 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_4500649980417596560_1064 size 29432
2013-10-31 20:30:50,196 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_conf.xml from client DFSClient_-580687144
2013-10-31 20:30:50,196 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_conf.xml is closed by DFSClient_-580687144
2013-10-31 20:30:50,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:30:50,207 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken. blk_6325929907356299574_1065
2013-10-31 20:30:50,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6325929907356299574_1065 src: /127.0.0.1:39845 dest: /127.0.0.1:46399
2013-10-31 20:30:50,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6325929907356299574_1065 src: /127.0.0.1:34356 dest: /127.0.0.1:37249
2013-10-31 20:30:50,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6325929907356299574_1065 src: /127.0.0.1:44139 dest: /127.0.0.1:33202
2013-10-31 20:30:50,220 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44139, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6325929907356299574_1065, duration: 4811205
2013-10-31 20:30:50,220 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6325929907356299574_1065 terminating
2013-10-31 20:30:50,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34356, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6325929907356299574_1065, duration: 3294358
2013-10-31 20:30:50,222 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6325929907356299574_1065 terminating
2013-10-31 20:30:50,222 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39845, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6325929907356299574_1065, duration: 4406210
2013-10-31 20:30:50,223 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6325929907356299574_1065 size 116
2013-10-31 20:30:50,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6325929907356299574_1065 terminating
2013-10-31 20:30:50,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6325929907356299574_1065 size 116
2013-10-31 20:30:50,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6325929907356299574_1065 size 116
2013-10-31 20:30:50,226 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken from client DFSClient_848976415
2013-10-31 20:30:50,227 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken is closed by DFSClient_848976415
2013-10-31 20:30:50,230 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken
2013-10-31 20:30:50,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.splitmetainfo dst=null perm=null
2013-10-31 20:30:50,233 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34358, bytes: 82, op: HDFS_READ, cliID: DFSClient_-580687144, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4293997882210496524_1061, duration: 122279
2013-10-31 20:30:50,234 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0007 = 38. Number of splits = 2
2013-10-31 20:30:50,234 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:50,235 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:50,235 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:50,235 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:50,235 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:50,236 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:30:50,236 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0007 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:30:50,236 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0007 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:30:50,344 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0007_m_000003_0' to tip task_20131031202710049_0007_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:30:50,348 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_m_000001_0'
2013-10-31 20:30:50,350 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0007_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:30:50,350 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0007_m_000003_0 which needs 1 slots
2013-10-31 20:30:50,350 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0007_m_000003_0 which needs 1 slots
2013-10-31 20:30:50,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken dst=null perm=null
2013-10-31 20:30:50,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44141, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6325929907356299574_1065, duration: 289279
2013-10-31 20:30:50,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml dst=null perm=null
2013-10-31 20:30:50,370 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35757, bytes: 29599, op: HDFS_READ, cliID: DFSClient_1200569121, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3746774599525171999_1062, duration: 392431
2013-10-31 20:30:50,402 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:30:50,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar dst=null perm=null
2013-10-31 20:30:50,429 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44144, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1200569121, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4734428612678706897_1059, duration: 1481791
2013-10-31 20:30:50,537 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0007_m_-1858196187
2013-10-31 20:30:50,538 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0007_m_-1858196187 spawned.
2013-10-31 20:30:50,541 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0007/attempt_20131031202710049_0007_m_000003_0/taskjvm.sh
2013-10-31 20:30:50,805 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4574790141223885316_1052 file build/test/data/dfs/data/data2/current/blk_-4574790141223885316 for deletion
2013-10-31 20:30:50,805 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1905784073861442021_1056 file build/test/data/dfs/data/data2/current/blk_1905784073861442021 for deletion
2013-10-31 20:30:50,805 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4574790141223885316_1052 at file build/test/data/dfs/data/data2/current/blk_-4574790141223885316
2013-10-31 20:30:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3286762115456329224_1050 file build/test/data/dfs/data/data1/current/blk_3286762115456329224 for deletion
2013-10-31 20:30:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1905784073861442021_1056 at file build/test/data/dfs/data/data2/current/blk_1905784073861442021
2013-10-31 20:30:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7708920851468258260_1051 file build/test/data/dfs/data/data1/current/blk_7708920851468258260 for deletion
2013-10-31 20:30:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3286762115456329224_1050 at file build/test/data/dfs/data/data1/current/blk_3286762115456329224
2013-10-31 20:30:50,807 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7708920851468258260_1051 at file build/test/data/dfs/data/data1/current/blk_7708920851468258260
2013-10-31 20:30:51,082 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_m_000002_0'
2013-10-31 20:30:51,293 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0006_m_000003_0'
2013-10-31 20:30:51,696 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272) Starting thread to transfer block blk_-4734428612678706897_1059 to 127.0.0.1:37249
2013-10-31 20:30:51,698 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4734428612678706897_1059 src: /127.0.0.1:34363 dest: /127.0.0.1:37249
2013-10-31 20:30:51,698 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272):Transmitted block blk_-4734428612678706897_1059 to /127.0.0.1:37249
2013-10-31 20:30:51,702 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4734428612678706897_1059 src: /127.0.0.1:34363 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:30:51,703 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4734428612678706897_1059 size 238055
2013-10-31 20:30:52,078 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6826955743783708016_1053 file build/test/data/dfs/data/data7/current/blk_-6826955743783708016 for deletion
2013-10-31 20:30:52,078 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1905784073861442021_1056 file build/test/data/dfs/data/data8/current/blk_1905784073861442021 for deletion
2013-10-31 20:30:52,078 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6826955743783708016_1053 at file build/test/data/dfs/data/data7/current/blk_-6826955743783708016
2013-10-31 20:30:52,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3286762115456329224_1050 file build/test/data/dfs/data/data7/current/blk_3286762115456329224 for deletion
2013-10-31 20:30:52,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1905784073861442021_1056 at file build/test/data/dfs/data/data8/current/blk_1905784073861442021
2013-10-31 20:30:52,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7708920851468258260_1051 file build/test/data/dfs/data/data8/current/blk_7708920851468258260 for deletion
2013-10-31 20:30:52,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3286762115456329224_1050 at file build/test/data/dfs/data/data7/current/blk_3286762115456329224
2013-10-31 20:30:52,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7708920851468258260_1051 at file build/test/data/dfs/data/data8/current/blk_7708920851468258260
2013-10-31 20:30:52,421 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_1905784073861442021_1056
2013-10-31 20:30:53,085 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0007_m_-1858196187 given task: attempt_20131031202710049_0007_m_000003_0
2013-10-31 20:30:53,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:30:54,106 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0006
2013-10-31 20:30:54,107 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0006_m_000004_0 not found in cache
2013-10-31 20:30:54,108 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0006 for user-log deletion with retainTimeStamp:1383337854107
2013-10-31 20:30:54,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1905784073861442021_1056 file build/test/data/dfs/data/data3/current/blk_1905784073861442021 for deletion
2013-10-31 20:30:54,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1905784073861442021_1056 at file build/test/data/dfs/data/data3/current/blk_1905784073861442021
2013-10-31 20:30:55,182 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0006_m_699960213 since job job_20131031202710049_0006 is dead
2013-10-31 20:30:55,193 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28436 with signal TERM. Exit code 0
2013-10-31 20:30:55,341 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0006_r_-459265034 since job job_20131031202710049_0006 is dead
2013-10-31 20:30:55,350 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0006
2013-10-31 20:30:55,351 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0006 for user-log deletion with retainTimeStamp:1383337855351
2013-10-31 20:30:55,351 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28893 with signal TERM. Exit code 0
2013-10-31 20:30:55,406 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:55,406 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:55,406 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:55,406 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0006_m_699960213 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:30:55,482 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0006_m_1968776560 since job job_20131031202710049_0006 is dead
2013-10-31 20:30:55,490 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28597 with signal TERM. Exit code 0
2013-10-31 20:30:55,528 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:55,528 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:55,528 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:55,528 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0006_r_-459265034 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:55,699 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:55,699 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:55,699 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:55,700 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0006_m_1968776560 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:56,083 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0006
2013-10-31 20:30:56,084 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0006 for user-log deletion with retainTimeStamp:1383337856084
2013-10-31 20:30:56,294 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0006
2013-10-31 20:30:56,295 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0006 for user-log deletion with retainTimeStamp:1383337856294
2013-10-31 20:30:56,505 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_m_000003_0 0.0% setup
2013-10-31 20:30:56,508 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0007_m_000003_0 is done.
2013-10-31 20:30:56,508 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0007_m_000003_0 was -1
2013-10-31 20:30:56,508 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:30:56,621 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0006_m_1263659617 since job job_20131031202710049_0006 is dead
2013-10-31 20:30:56,631 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28661 with signal TERM. Exit code 0
2013-10-31 20:30:56,834 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:56,834 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:56,834 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:56,834 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0006_m_1263659617 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:56,909 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0006_m_1769982779 since job job_20131031202710049_0006 is dead
2013-10-31 20:30:56,909 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0006_m_-1165563184 since job job_20131031202710049_0006 is dead
2013-10-31 20:30:56,922 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28750 with signal TERM. Exit code 0
2013-10-31 20:30:56,922 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28795 with signal TERM. Exit code 0
2013-10-31 20:30:57,147 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:57,147 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:57,147 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:57,147 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0006_m_-1165563184 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:57,166 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:30:57,166 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:30:57,166 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:30:57,166 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0006_m_1769982779 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:30:59,358 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0007_m_000003_0' has completed task_20131031202710049_0007_m_000003 successfully.
2013-10-31 20:30:59,361 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0007_m_000000_0' to tip task_20131031202710049_0007_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:30:59,361 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0007_m_000000
2013-10-31 20:30:59,363 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0007_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:30:59,364 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0007_m_000000_0 which needs 1 slots
2013-10-31 20:30:59,364 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0007_m_000000_0 which needs 1 slots
2013-10-31 20:30:59,398 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0007_m_1664053101
2013-10-31 20:30:59,399 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0007_m_1664053101 spawned.
2013-10-31 20:30:59,402 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0007/attempt_20131031202710049_0007_m_000000_0/taskjvm.sh
2013-10-31 20:31:00,090 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0007_m_000001_0' to tip task_20131031202710049_0007_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:31:00,090 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0007_m_000001
2013-10-31 20:31:00,092 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0007_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:31:00,092 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0007_m_000001_0 which needs 1 slots
2013-10-31 20:31:00,092 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0007_m_000001_0 which needs 1 slots
2013-10-31 20:31:00,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007/jobToken dst=null perm=null
2013-10-31 20:31:00,098 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34369, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6325929907356299574_1065, duration: 315944
2013-10-31 20:31:00,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.xml dst=null perm=null
2013-10-31 20:31:00,105 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44153, bytes: 29599, op: HDFS_READ, cliID: DFSClient_2082213566, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3746774599525171999_1062, duration: 404834
2013-10-31 20:31:00,124 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:31:00,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.jar dst=null perm=null
2013-10-31 20:31:00,156 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35768, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2082213566, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4734428612678706897_1059, duration: 632037
2013-10-31 20:31:00,210 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0007_m_625865711
2013-10-31 20:31:00,211 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0007_m_625865711 spawned.
2013-10-31 20:31:00,212 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0007/attempt_20131031202710049_0007_m_000001_0/taskjvm.sh
2013-10-31 20:31:00,260 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0007_m_1664053101 given task: attempt_20131031202710049_0007_m_000000_0
2013-10-31 20:31:00,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split dst=null perm=null
2013-10-31 20:31:00,778 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34374, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0007_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6426401666176928517_1060, duration: 166096
2013-10-31 20:31:00,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:31:01,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44158, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0007_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4376294229090259720_1013, duration: 147194
2013-10-31 20:31:01,192 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0007_m_625865711 given task: attempt_20131031202710049_0007_m_000001_0
2013-10-31 20:31:01,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007/job.split dst=null perm=null
2013-10-31 20:31:01,697 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44160, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0007_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6426401666176928517_1060, duration: 166863
2013-10-31 20:31:01,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:31:01,996 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39869, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0007_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1710730409183361578_1012, duration: 110018
2013-10-31 20:31:03,707 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:31:03,709 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0007_m_000000_0 is done.
2013-10-31 20:31:03,710 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0007_m_000000_0 was 501
2013-10-31 20:31:03,710 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:04,364 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0007_m_000003_0
2013-10-31 20:31:04,364 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0007_m_000003_0
2013-10-31 20:31:04,364 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0007_m_000003_0 not found in cache
2013-10-31 20:31:04,626 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:31:04,629 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0007_m_000001_0 is done.
2013-10-31 20:31:04,630 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0007_m_000001_0 was 501
2013-10-31 20:31:04,630 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:05,370 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0007_m_000000_0' has completed task_20131031202710049_0007_m_000000 successfully.
2013-10-31 20:31:05,551 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0007_r_000000_0' to tip task_20131031202710049_0007_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:31:05,553 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0007_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:31:05,554 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0007_r_000000_0 which needs 1 slots
2013-10-31 20:31:05,554 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0007_r_000000_0 which needs 1 slots
2013-10-31 20:31:05,593 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0007_r_318773650
2013-10-31 20:31:05,594 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0007_r_318773650 spawned.
2013-10-31 20:31:05,597 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0007/attempt_20131031202710049_0007_r_000000_0/taskjvm.sh
2013-10-31 20:31:06,098 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0007_m_000001_0' has completed task_20131031202710049_0007_m_000001 successfully.
2013-10-31 20:31:06,612 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0007_r_318773650 given task: attempt_20131031202710049_0007_r_000000_0
2013-10-31 20:31:08,051 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:31:08,066 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:31:08,075 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:31:08,080 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:31:08,086 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:31:08,091 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:31:08,097 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:31:08,097 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:31:12,321 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53422, bytes: 501, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0007_m_000000_0, duration: 8623786
2013-10-31 20:31:12,338 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:53715, bytes: 501, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0007_m_000001_0, duration: 9177386
2013-10-31 20:31:13,138 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:31:13,177 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:31:13,233 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:31:13,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:13,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:13,482 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0/part-00000. blk_2943885495038914141_1066
2013-10-31 20:31:13,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2943885495038914141_1066 src: /127.0.0.1:44166 dest: /127.0.0.1:33202
2013-10-31 20:31:13,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2943885495038914141_1066 src: /127.0.0.1:35781 dest: /127.0.0.1:49827
2013-10-31 20:31:13,513 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2943885495038914141_1066 src: /127.0.0.1:39876 dest: /127.0.0.1:46399
2013-10-31 20:31:13,516 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39876, dest: /127.0.0.1:46399, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0007_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2943885495038914141_1066, duration: 2579836
2013-10-31 20:31:13,517 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2943885495038914141_1066 terminating
2013-10-31 20:31:13,517 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35781, dest: /127.0.0.1:49827, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0007_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2943885495038914141_1066, duration: 3234700
2013-10-31 20:31:13,518 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2943885495038914141_1066 terminating
2013-10-31 20:31:13,519 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2943885495038914141_1066 size 1040
2013-10-31 20:31:13,519 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44166, dest: /127.0.0.1:33202, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0007_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2943885495038914141_1066, duration: 5222513
2013-10-31 20:31:13,519 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2943885495038914141_1066 size 1040
2013-10-31 20:31:13,519 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2943885495038914141_1066 terminating
2013-10-31 20:31:13,521 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0007_r_000000_0
2013-10-31 20:31:13,522 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0007_r_000000_0
2013-10-31 20:31:13,523 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2943885495038914141_1066 size 1040
2013-10-31 20:31:13,558 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0007_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:31:13,558 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:31:14,562 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0007_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:31:14,564 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0007_r_000000_0
2013-10-31 20:31:15,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0 dst=null perm=null
2013-10-31 20:31:15,573 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 352 Total time for transactions(ms): 8Number of transactions batched in Syncs: 12 Number of syncs: 236 SyncTimes(ms): 5656 1069
2013-10-31 20:31:15,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:15,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:15,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary/_attempt_20131031202710049_0007_r_000000_0 dst=null perm=null
2013-10-31 20:31:16,190 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 20:31:16,192 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 20:31:16,192 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0007_r_000000_0 is done.
2013-10-31 20:31:16,193 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0007_r_000000_0 was -1
2013-10-31 20:31:16,193 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:17,567 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0007_r_000000_0' has completed task_20131031202710049_0007_r_000000 successfully.
2013-10-31 20:31:17,572 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0007_m_000002_0' to tip task_20131031202710049_0007_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:31:17,575 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0007_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:31:17,575 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0007_m_000002_0 which needs 1 slots
2013-10-31 20:31:17,575 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0007_m_000002_0 which needs 1 slots
2013-10-31 20:31:17,613 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0007/attempt_20131031202710049_0007_m_000002_0. Attempting to reuse: jvm_20131031202710049_0007_m_1664053101
2013-10-31 20:31:17,783 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0007_m_1664053101 given task: attempt_20131031202710049_0007_m_000002_0
2013-10-31 20:31:17,895 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_m_000002_0 0.0%
2013-10-31 20:31:17,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_temporary dst=null perm=null
2013-10-31 20:31:17,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:17,912 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_SUCCESS from client DFSClient_attempt_20131031202710049_0007_m_000002_0
2013-10-31 20:31:17,913 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0007_m_000002_0
2013-10-31 20:31:17,919 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4734428612678706897 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:17,919 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4734428612678706897 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:17,919 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4734428612678706897 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:17,919 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4734428612678706897 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:17,920 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6426401666176928517 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:17,920 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6426401666176928517 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:17,920 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6426401666176928517 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:17,920 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6426401666176928517 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:17,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4293997882210496524 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:17,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4293997882210496524 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:17,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4293997882210496524 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:17,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3746774599525171999 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:17,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3746774599525171999 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:17,922 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3746774599525171999 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:17,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0007 dst=null perm=null
2013-10-31 20:31:19,425 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_6426401666176928517_1060 blk_-4734428612678706897_1059 blk_3746774599525171999_1062 blk_4293997882210496524_1061
2013-10-31 20:31:19,426 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_6426401666176928517_1060 blk_-4734428612678706897_1059 blk_3746774599525171999_1062 blk_4293997882210496524_1061
2013-10-31 20:31:20,851 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0007_m_000002_0 0.0% cleanup
2013-10-31 20:31:20,853 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0007_m_000002_0 is done.
2013-10-31 20:31:20,853 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0007_m_000002_0 was -1
2013-10-31 20:31:20,853 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:21,706 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4734428612678706897_1059 file build/test/data/dfs/data/data5/current/blk_-4734428612678706897 for deletion
2013-10-31 20:31:21,706 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3746774599525171999_1062 file build/test/data/dfs/data/data6/current/blk_3746774599525171999 for deletion
2013-10-31 20:31:21,707 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4734428612678706897_1059 at file build/test/data/dfs/data/data5/current/blk_-4734428612678706897
2013-10-31 20:31:21,707 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3746774599525171999_1062 at file build/test/data/dfs/data/data6/current/blk_3746774599525171999
2013-10-31 20:31:21,707 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4293997882210496524_1061 file build/test/data/dfs/data/data5/current/blk_4293997882210496524 for deletion
2013-10-31 20:31:21,708 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4293997882210496524_1061 at file build/test/data/dfs/data/data5/current/blk_4293997882210496524
2013-10-31 20:31:21,708 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6426401666176928517_1060 file build/test/data/dfs/data/data6/current/blk_6426401666176928517 for deletion
2013-10-31 20:31:21,708 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6426401666176928517_1060 at file build/test/data/dfs/data/data6/current/blk_6426401666176928517
2013-10-31 20:31:22,088 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4734428612678706897_1059 file build/test/data/dfs/data/data7/current/blk_-4734428612678706897 for deletion
2013-10-31 20:31:22,088 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3746774599525171999_1062 file build/test/data/dfs/data/data8/current/blk_3746774599525171999 for deletion
2013-10-31 20:31:22,088 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4734428612678706897_1059 at file build/test/data/dfs/data/data7/current/blk_-4734428612678706897
2013-10-31 20:31:22,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4293997882210496524_1061 file build/test/data/dfs/data/data7/current/blk_4293997882210496524 for deletion
2013-10-31 20:31:22,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3746774599525171999_1062 at file build/test/data/dfs/data/data8/current/blk_3746774599525171999
2013-10-31 20:31:22,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6426401666176928517_1060 file build/test/data/dfs/data/data8/current/blk_6426401666176928517 for deletion
2013-10-31 20:31:22,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4293997882210496524_1061 at file build/test/data/dfs/data/data7/current/blk_4293997882210496524
2013-10-31 20:31:22,090 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6426401666176928517_1060 at file build/test/data/dfs/data/data8/current/blk_6426401666176928517
2013-10-31 20:31:22,426 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_6426401666176928517_1060 blk_-4734428612678706897_1059 blk_3746774599525171999_1062
2013-10-31 20:31:22,426 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_6426401666176928517_1060 blk_-4734428612678706897_1059 blk_4293997882210496524_1061
2013-10-31 20:31:22,576 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0007_r_000000_0
2013-10-31 20:31:22,576 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0007_r_000000_0
2013-10-31 20:31:23,581 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0007_m_000002_0' has completed task_20131031202710049_0007_m_000002 successfully.
2013-10-31 20:31:23,582 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0007 has completed successfully.
2013-10-31 20:31:23,583 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0007,submitTime=1383251450111,launchTime=1383251450236,firstMapTaskLaunchTime=1383251459360,firstReduceTaskLaunchTime=1383251465550,firstJobSetupTaskLaunchTime=1383251450344,firstJobCleanupTaskLaunchTime=1383251477572,finishTime=1383251483582,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=18,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5FE5D552DBE44D8B8859E538CE0C5AEC/3639498DF8354826B642281B1691B2C8] lower*upper/(1/2)
2013-10-31 20:31:23,589 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_1383251450111_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2F3639498DF8354826. blk_-7419656928004317539_1067
2013-10-31 20:31:23,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7419656928004317539_1067 src: /127.0.0.1:44172 dest: /127.0.0.1:33202
2013-10-31 20:31:23,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7419656928004317539_1067 src: /127.0.0.1:39881 dest: /127.0.0.1:46399
2013-10-31 20:31:23,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7419656928004317539_1067 src: /127.0.0.1:34392 dest: /127.0.0.1:37249
2013-10-31 20:31:23,607 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34392, dest: /127.0.0.1:37249, bytes: 20695, op: HDFS_WRITE, cliID: DFSClient_-580687144, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7419656928004317539_1067, duration: 4018775
2013-10-31 20:31:23,608 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7419656928004317539_1067 terminating
2013-10-31 20:31:23,609 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39881, dest: /127.0.0.1:46399, bytes: 20695, op: HDFS_WRITE, cliID: DFSClient_-580687144, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7419656928004317539_1067, duration: 5429060
2013-10-31 20:31:23,609 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7419656928004317539_1067 terminating
2013-10-31 20:31:23,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44172, dest: /127.0.0.1:33202, bytes: 20695, op: HDFS_WRITE, cliID: DFSClient_-580687144, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7419656928004317539_1067, duration: 7177601
2013-10-31 20:31:23,611 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7419656928004317539_1067 terminating
2013-10-31 20:31:23,614 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7419656928004317539_1067 size 20695
2013-10-31 20:31:23,614 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_1383251450111_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2F3639498DF8354826 from client DFSClient_-580687144
2013-10-31 20:31:23,614 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/_logs/history/job_20131031202710049_0007_1383251450111_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2F3639498DF8354826 is closed by DFSClient_-580687144
2013-10-31 20:31:23,615 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7419656928004317539_1067 size 20695
2013-10-31 20:31:23,616 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7419656928004317539_1067 size 20695
2013-10-31 20:31:23,621 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0007_1383251450111_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2F3639498DF8354826 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:31:23,624 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0007_m_000000_0'
2013-10-31 20:31:23,625 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0007_m_000002_0'
2013-10-31 20:31:23,625 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0007_m_000003_0'
2013-10-31 20:31:23,627 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0007_r_000000_0'
2013-10-31 20:31:23,627 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6325929907356299574 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:23,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6325929907356299574 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:23,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6325929907356299574 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:23,631 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...alue/true/true/true/false
2013-10-31 20:31:23,632 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0007_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:31:23,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0007 dst=null perm=null
2013-10-31 20:31:23,639 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:31:23,640 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:31:23,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:23,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:31:23,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:23,666 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar. blk_8039487278617192869_1068
2013-10-31 20:31:23,667 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8039487278617192869_1068 src: /127.0.0.1:39884 dest: /127.0.0.1:46399
2013-10-31 20:31:23,669 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8039487278617192869_1068 src: /127.0.0.1:44177 dest: /127.0.0.1:33202
2013-10-31 20:31:23,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8039487278617192869_1068 src: /127.0.0.1:34396 dest: /127.0.0.1:37249
2013-10-31 20:31:23,682 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34396, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8039487278617192869_1068, duration: 8129506
2013-10-31 20:31:23,682 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8039487278617192869_1068 terminating
2013-10-31 20:31:23,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44177, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8039487278617192869_1068, duration: 9626634
2013-10-31 20:31:23,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8039487278617192869_1068 terminating
2013-10-31 20:31:23,685 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8039487278617192869_1068 size 238055
2013-10-31 20:31:23,685 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39884, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8039487278617192869_1068, duration: 11626704
2013-10-31 20:31:23,686 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8039487278617192869_1068 terminating
2013-10-31 20:31:23,686 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8039487278617192869_1068 size 238055
2013-10-31 20:31:23,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_8039487278617192869_1068 size 238055
2013-10-31 20:31:23,688 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar from client DFSClient_848976415
2013-10-31 20:31:23,689 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar is closed by DFSClient_848976415
2013-10-31 20:31:23,694 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar. New replication is 10
2013-10-31 20:31:23,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar dst=null perm=null
2013-10-31 20:31:23,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:23,704 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:31:23,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA dst=null perm=null
2013-10-31 20:31:23,710 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:31:23,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/part-00000 dst=null perm=null
2013-10-31 20:31:23,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:23,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:23,725 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split. New replication is 10
2013-10-31 20:31:23,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split dst=null perm=null
2013-10-31 20:31:23,731 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split. blk_-840931425823280771_1069
2013-10-31 20:31:23,733 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-840931425823280771_1069 src: /127.0.0.1:34397 dest: /127.0.0.1:37249
2013-10-31 20:31:23,735 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-840931425823280771_1069 src: /127.0.0.1:44180 dest: /127.0.0.1:33202
2013-10-31 20:31:23,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-840931425823280771_1069 src: /127.0.0.1:35795 dest: /127.0.0.1:49827
2013-10-31 20:31:23,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-840931425823280771_1069 src: /127.0.0.1:39890 dest: /127.0.0.1:46399
2013-10-31 20:31:23,742 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39890, dest: /127.0.0.1:46399, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-840931425823280771_1069, duration: 926654
2013-10-31 20:31:23,742 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-840931425823280771_1069 terminating
2013-10-31 20:31:23,744 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35795, dest: /127.0.0.1:49827, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-840931425823280771_1069, duration: 2581760
2013-10-31 20:31:23,744 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-840931425823280771_1069 terminating
2013-10-31 20:31:23,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44180, dest: /127.0.0.1:33202, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-840931425823280771_1069, duration: 4230885
2013-10-31 20:31:23,746 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-840931425823280771_1069 size 358
2013-10-31 20:31:23,746 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-840931425823280771_1069 terminating
2013-10-31 20:31:23,747 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34397, dest: /127.0.0.1:37249, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-840931425823280771_1069, duration: 6076931
2013-10-31 20:31:23,747 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-840931425823280771_1069 size 358
2013-10-31 20:31:23,748 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-840931425823280771_1069 terminating
2013-10-31 20:31:23,750 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-840931425823280771_1069 size 358
2013-10-31 20:31:23,755 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split from client DFSClient_848976415
2013-10-31 20:31:23,755 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split is closed by DFSClient_848976415
2013-10-31 20:31:23,756 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-840931425823280771_1069 size 358
2013-10-31 20:31:23,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:23,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:23,773 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.splitmetainfo. blk_-3869408726430639669_1070
2013-10-31 20:31:23,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3869408726430639669_1070 src: /127.0.0.1:34401 dest: /127.0.0.1:37249
2013-10-31 20:31:23,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3869408726430639669_1070 src: /127.0.0.1:39892 dest: /127.0.0.1:46399
2013-10-31 20:31:23,778 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3869408726430639669_1070 src: /127.0.0.1:35799 dest: /127.0.0.1:49827
2013-10-31 20:31:23,781 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35799, dest: /127.0.0.1:49827, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3869408726430639669_1070, duration: 776210
2013-10-31 20:31:23,781 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3869408726430639669_1070 terminating
2013-10-31 20:31:23,782 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-3869408726430639669_1070 size 45
2013-10-31 20:31:23,783 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39892, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3869408726430639669_1070, duration: 2437762
2013-10-31 20:31:23,783 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3869408726430639669_1070 terminating
2013-10-31 20:31:23,785 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34401, dest: /127.0.0.1:37249, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3869408726430639669_1070, duration: 4305948
2013-10-31 20:31:23,785 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-3869408726430639669_1070 size 45
2013-10-31 20:31:23,785 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3869408726430639669_1070 terminating
2013-10-31 20:31:23,789 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3869408726430639669_1070 size 45
2013-10-31 20:31:23,789 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:31:23,790 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:31:23,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4734428612678706897_1059 file build/test/data/dfs/data/data2/current/blk_-4734428612678706897 for deletion
2013-10-31 20:31:23,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4293997882210496524_1061 file build/test/data/dfs/data/data2/current/blk_4293997882210496524 for deletion
2013-10-31 20:31:23,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4734428612678706897_1059 at file build/test/data/dfs/data/data2/current/blk_-4734428612678706897
2013-10-31 20:31:23,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6426401666176928517_1060 file build/test/data/dfs/data/data1/current/blk_6426401666176928517 for deletion
2013-10-31 20:31:23,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4293997882210496524_1061 at file build/test/data/dfs/data/data2/current/blk_4293997882210496524
2013-10-31 20:31:23,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6426401666176928517_1060 at file build/test/data/dfs/data/data1/current/blk_6426401666176928517
2013-10-31 20:31:24,120 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0007_m_000001_0'
2013-10-31 20:31:24,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:24,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:24,152 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml. blk_-146153167274804708_1071
2013-10-31 20:31:24,153 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-146153167274804708_1071 src: /127.0.0.1:39894 dest: /127.0.0.1:46399
2013-10-31 20:31:24,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-146153167274804708_1071 src: /127.0.0.1:34405 dest: /127.0.0.1:37249
2013-10-31 20:31:24,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-146153167274804708_1071 src: /127.0.0.1:35802 dest: /127.0.0.1:49827
2013-10-31 20:31:24,161 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35802, dest: /127.0.0.1:49827, bytes: 28894, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-146153167274804708_1071, duration: 969449
2013-10-31 20:31:24,161 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-146153167274804708_1071 terminating
2013-10-31 20:31:24,162 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34405, dest: /127.0.0.1:37249, bytes: 28894, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-146153167274804708_1071, duration: 2419679
2013-10-31 20:31:24,162 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-146153167274804708_1071 size 28894
2013-10-31 20:31:24,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-146153167274804708_1071 terminating
2013-10-31 20:31:24,164 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39894, dest: /127.0.0.1:46399, bytes: 28894, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-146153167274804708_1071, duration: 4393833
2013-10-31 20:31:24,164 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-146153167274804708_1071 size 28894
2013-10-31 20:31:24,165 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-146153167274804708_1071 terminating
2013-10-31 20:31:24,166 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml from client DFSClient_848976415
2013-10-31 20:31:24,167 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml is closed by DFSClient_848976415
2013-10-31 20:31:24,167 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-146153167274804708_1071 size 28894
2013-10-31 20:31:24,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml dst=null perm=null
2013-10-31 20:31:24,185 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39898, bytes: 29122, op: HDFS_READ, cliID: DFSClient_683589222, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-146153167274804708_1071, duration: 406772
2013-10-31 20:31:24,205 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0008: nMaps=1 nReduces=1 max=-1
2013-10-31 20:31:24,206 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0008 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:31:24,206 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0008
2013-10-31 20:31:24,206 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0008 RESULT=SUCCESS
2013-10-31 20:31:24,206 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0008
2013-10-31 20:31:24,208 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0008
2013-10-31 20:31:24,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_1383251484175_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2FD248D280774048DA dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:24,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:24,242 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_conf.xml. blk_6461211702144248393_1073
2013-10-31 20:31:24,244 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6461211702144248393_1073 src: /127.0.0.1:35805 dest: /127.0.0.1:49827
2013-10-31 20:31:24,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6461211702144248393_1073 src: /127.0.0.1:34410 dest: /127.0.0.1:37249
2013-10-31 20:31:24,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6461211702144248393_1073 src: /127.0.0.1:44193 dest: /127.0.0.1:33202
2013-10-31 20:31:24,253 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44193, dest: /127.0.0.1:33202, bytes: 28959, op: HDFS_WRITE, cliID: DFSClient_683589222, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6461211702144248393_1073, duration: 1529257
2013-10-31 20:31:24,253 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6461211702144248393_1073 terminating
2013-10-31 20:31:24,254 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6461211702144248393_1073 size 28959
2013-10-31 20:31:24,255 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34410, dest: /127.0.0.1:37249, bytes: 28959, op: HDFS_WRITE, cliID: DFSClient_683589222, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6461211702144248393_1073, duration: 3291527
2013-10-31 20:31:24,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6461211702144248393_1073 terminating
2013-10-31 20:31:24,257 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35805, dest: /127.0.0.1:49827, bytes: 28959, op: HDFS_WRITE, cliID: DFSClient_683589222, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6461211702144248393_1073, duration: 5686467
2013-10-31 20:31:24,257 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6461211702144248393_1073 terminating
2013-10-31 20:31:24,258 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6461211702144248393_1073 size 28959
2013-10-31 20:31:24,259 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_conf.xml from client DFSClient_683589222
2013-10-31 20:31:24,259 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_conf.xml is closed by DFSClient_683589222
2013-10-31 20:31:24,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6461211702144248393_1073 size 28959
2013-10-31 20:31:24,263 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4734428612678706897_1059 file build/test/data/dfs/data/data3/current/blk_-4734428612678706897 for deletion
2013-10-31 20:31:24,263 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3746774599525171999_1062 file build/test/data/dfs/data/data3/current/blk_3746774599525171999 for deletion
2013-10-31 20:31:24,263 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4734428612678706897_1059 at file build/test/data/dfs/data/data3/current/blk_-4734428612678706897
2013-10-31 20:31:24,263 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6426401666176928517_1060 file build/test/data/dfs/data/data4/current/blk_6426401666176928517 for deletion
2013-10-31 20:31:24,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3746774599525171999_1062 at file build/test/data/dfs/data/data3/current/blk_3746774599525171999
2013-10-31 20:31:24,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6426401666176928517_1060 at file build/test/data/dfs/data/data4/current/blk_6426401666176928517
2013-10-31 20:31:24,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:24,272 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008/jobToken. blk_9165694415457292386_1074
2013-10-31 20:31:24,274 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9165694415457292386_1074 src: /127.0.0.1:35808 dest: /127.0.0.1:49827
2013-10-31 20:31:24,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9165694415457292386_1074 src: /127.0.0.1:44195 dest: /127.0.0.1:33202
2013-10-31 20:31:24,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9165694415457292386_1074 src: /127.0.0.1:39904 dest: /127.0.0.1:46399
2013-10-31 20:31:24,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39904, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_9165694415457292386_1074, duration: 2170512
2013-10-31 20:31:24,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9165694415457292386_1074 terminating
2013-10-31 20:31:24,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44195, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_9165694415457292386_1074, duration: 2982785
2013-10-31 20:31:24,287 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9165694415457292386_1074 terminating
2013-10-31 20:31:24,287 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_9165694415457292386_1074 size 116
2013-10-31 20:31:24,288 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35808, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_9165694415457292386_1074, duration: 4115186
2013-10-31 20:31:24,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_9165694415457292386_1074 size 116
2013-10-31 20:31:24,288 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9165694415457292386_1074 terminating
2013-10-31 20:31:24,292 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008/jobToken from client DFSClient_848976415
2013-10-31 20:31:24,292 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008/jobToken is closed by DFSClient_848976415
2013-10-31 20:31:24,292 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_9165694415457292386_1074 size 116
2013-10-31 20:31:24,297 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008/jobToken
2013-10-31 20:31:24,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.splitmetainfo dst=null perm=null
2013-10-31 20:31:24,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34415, bytes: 49, op: HDFS_READ, cliID: DFSClient_683589222, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3869408726430639669_1070, duration: 271213
2013-10-31 20:31:24,302 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0008 = 1040. Number of splits = 1
2013-10-31 20:31:24,302 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:24,303 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:24,303 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:24,303 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0008 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:31:24,303 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0008 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:31:24,327 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0008_m_000002_0' to tip task_20131031202710049_0008_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:31:24,335 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0008_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:31:24,335 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0008_m_000002_0 which needs 1 slots
2013-10-31 20:31:24,335 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0007
2013-10-31 20:31:24,335 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0008_m_000002_0 which needs 1 slots
2013-10-31 20:31:24,336 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0007 being deleted.
2013-10-31 20:31:24,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008/jobToken dst=null perm=null
2013-10-31 20:31:24,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39906, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_9165694415457292386_1074, duration: 253466
2013-10-31 20:31:24,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.xml dst=null perm=null
2013-10-31 20:31:24,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34418, bytes: 29122, op: HDFS_READ, cliID: DFSClient_1245551012, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-146153167274804708_1071, duration: 384545
2013-10-31 20:31:24,385 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:31:24,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.jar dst=null perm=null
2013-10-31 20:31:24,421 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34419, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1245551012, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8039487278617192869_1068, duration: 1369910
2013-10-31 20:31:24,518 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0008_m_-184015594
2013-10-31 20:31:24,519 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0008_m_-184015594 spawned.
2013-10-31 20:31:24,520 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0008/attempt_20131031202710049_0008_m_000002_0/taskjvm.sh
2013-10-31 20:31:25,142 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0007
2013-10-31 20:31:25,143 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0007 being deleted.
2013-10-31 20:31:25,427 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:46399 to replicate blk_8039487278617192869_1068 to datanode(s) 127.0.0.1:49827
2013-10-31 20:31:25,428 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_6325929907356299574_1065
2013-10-31 20:31:25,428 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_6325929907356299574_1065
2013-10-31 20:31:25,863 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0008_m_-184015594 given task: attempt_20131031202710049_0008_m_000002_0
2013-10-31 20:31:26,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:26,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6325929907356299574_1065 file build/test/data/dfs/data/data1/current/blk_6325929907356299574 for deletion
2013-10-31 20:31:26,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6325929907356299574_1065 at file build/test/data/dfs/data/data1/current/blk_6325929907356299574
2013-10-31 20:31:27,708 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272) Starting thread to transfer block blk_8039487278617192869_1068 to 127.0.0.1:49827
2013-10-31 20:31:27,708 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6325929907356299574_1065 file build/test/data/dfs/data/data6/current/blk_6325929907356299574 for deletion
2013-10-31 20:31:27,709 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6325929907356299574_1065 at file build/test/data/dfs/data/data6/current/blk_6325929907356299574
2013-10-31 20:31:27,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8039487278617192869_1068 src: /127.0.0.1:35818 dest: /127.0.0.1:49827
2013-10-31 20:31:27,710 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272):Transmitted block blk_8039487278617192869_1068 to /127.0.0.1:49827
2013-10-31 20:31:27,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8039487278617192869_1068 src: /127.0.0.1:35818 dest: /127.0.0.1:49827 of size 238055
2013-10-31 20:31:27,719 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8039487278617192869_1068 size 238055
2013-10-31 20:31:28,429 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_6325929907356299574_1065
2013-10-31 20:31:28,628 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0007
2013-10-31 20:31:28,628 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0007_m_000002_0 not found in cache
2013-10-31 20:31:28,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0007 for user-log deletion with retainTimeStamp:1383337888629
2013-10-31 20:31:28,723 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0007_r_318773650 since job job_20131031202710049_0007 is dead
2013-10-31 20:31:28,733 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29406 with signal TERM. Exit code 0
2013-10-31 20:31:28,929 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:31:28,929 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:31:28,929 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:31:28,929 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0007_r_318773650 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:31:28,975 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0007_m_1664053101 since job job_20131031202710049_0007 is dead
2013-10-31 20:31:28,985 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29256 with signal TERM. Exit code 0
2013-10-31 20:31:29,121 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0007
2013-10-31 20:31:29,122 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0007 for user-log deletion with retainTimeStamp:1383337889121
2013-10-31 20:31:29,159 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:31:29,159 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:31:29,159 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:31:29,159 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0007_m_1664053101 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:31:29,212 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0007_m_625865711 since job job_20131031202710049_0007 is dead
2013-10-31 20:31:29,221 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29319 with signal TERM. Exit code 0
2013-10-31 20:31:29,295 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_m_000002_0 0.0% setup
2013-10-31 20:31:29,296 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0008_m_000002_0 is done.
2013-10-31 20:31:29,296 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0008_m_000002_0 was -1
2013-10-31 20:31:29,296 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:29,455 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:31:29,456 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:31:29,456 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:31:29,456 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0007_m_625865711 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:31:30,101 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0007_m_-1858196187 since job job_20131031202710049_0007 is dead
2013-10-31 20:31:30,109 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29105 with signal TERM. Exit code 0
2013-10-31 20:31:30,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6325929907356299574_1065 file build/test/data/dfs/data/data3/current/blk_6325929907356299574 for deletion
2013-10-31 20:31:30,276 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6325929907356299574_1065 at file build/test/data/dfs/data/data3/current/blk_6325929907356299574
2013-10-31 20:31:30,339 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0008_m_000002_0' has completed task_20131031202710049_0008_m_000002 successfully.
2013-10-31 20:31:30,340 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0008_m_000000_0' to tip task_20131031202710049_0008_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:31:30,341 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0008_m_000000
2013-10-31 20:31:30,342 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0008_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:31:30,342 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0008_m_000000_0 which needs 1 slots
2013-10-31 20:31:30,342 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0008_m_000000_0 which needs 1 slots
2013-10-31 20:31:30,358 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0008_m_829744483
2013-10-31 20:31:30,360 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0008_m_829744483 spawned.
2013-10-31 20:31:30,361 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0008/attempt_20131031202710049_0008_m_000000_0/taskjvm.sh
2013-10-31 20:31:30,423 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:31:30,423 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:31:30,423 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:31:30,423 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0007_m_-1858196187 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:31:31,201 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0008_m_829744483 given task: attempt_20131031202710049_0008_m_000000_0
2013-10-31 20:31:31,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008/job.split dst=null perm=null
2013-10-31 20:31:31,692 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39915, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0008_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-840931425823280771_1069, duration: 264424
2013-10-31 20:31:31,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/part-00000 dst=null perm=null
2013-10-31 20:31:31,731 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35822, bytes: 1052, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0008_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2943885495038914141_1066, duration: 378931
2013-10-31 20:31:34,619 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA/part-00000:0+1040
2013-10-31 20:31:34,623 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0008_m_000000_0 is done.
2013-10-31 20:31:34,623 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0008_m_000000_0 was 1130
2013-10-31 20:31:34,624 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:35,342 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0008_m_000002_0
2013-10-31 20:31:35,342 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0008_m_000002_0
2013-10-31 20:31:35,343 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0008_m_000002_0 not found in cache
2013-10-31 20:31:36,348 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0008_m_000000_0' has completed task_20131031202710049_0008_m_000000 successfully.
2013-10-31 20:31:36,351 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0008_r_000000_0' to tip task_20131031202710049_0008_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:31:36,353 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0008_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:31:36,353 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0008_r_000000_0 which needs 1 slots
2013-10-31 20:31:36,353 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0008_r_000000_0 which needs 1 slots
2013-10-31 20:31:36,393 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0008_r_-693547091
2013-10-31 20:31:36,393 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0008_r_-693547091 spawned.
2013-10-31 20:31:36,396 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0008/attempt_20131031202710049_0008_r_000000_0/taskjvm.sh
2013-10-31 20:31:37,231 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0008_r_-693547091 given task: attempt_20131031202710049_0008_r_000000_0
2013-10-31 20:31:42,929 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:45494, bytes: 1130, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0008_m_000000_0, duration: 9056663
2013-10-31 20:31:43,724 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:31:43,800 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:31:43,864 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:31:44,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:44,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:44,104 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0/part-00000. blk_6991253994306906579_1075
2013-10-31 20:31:44,133 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6991253994306906579_1075 src: /127.0.0.1:34433 dest: /127.0.0.1:37249
2013-10-31 20:31:44,134 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6991253994306906579_1075 src: /127.0.0.1:35830 dest: /127.0.0.1:49827
2013-10-31 20:31:44,136 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6991253994306906579_1075 src: /127.0.0.1:39925 dest: /127.0.0.1:46399
2013-10-31 20:31:44,139 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39925, dest: /127.0.0.1:46399, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0008_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6991253994306906579_1075, duration: 1915462
2013-10-31 20:31:44,139 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6991253994306906579_1075 terminating
2013-10-31 20:31:44,143 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6991253994306906579_1075 size 1040
2013-10-31 20:31:44,143 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35830, dest: /127.0.0.1:49827, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0008_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6991253994306906579_1075, duration: 2845085
2013-10-31 20:31:44,143 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6991253994306906579_1075 terminating
2013-10-31 20:31:44,143 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6991253994306906579_1075 size 1040
2013-10-31 20:31:44,145 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34433, dest: /127.0.0.1:37249, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0008_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6991253994306906579_1075, duration: 7466252
2013-10-31 20:31:44,145 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6991253994306906579_1075 terminating
2013-10-31 20:31:44,147 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0008_r_000000_0
2013-10-31 20:31:44,148 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0008_r_000000_0
2013-10-31 20:31:44,150 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6991253994306906579_1075 size 1040
2013-10-31 20:31:44,183 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0008_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:31:44,183 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:31:45,362 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0008_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:46857
2013-10-31 20:31:45,363 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0008_r_000000_0
2013-10-31 20:31:46,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0 dst=null perm=null
2013-10-31 20:31:46,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:46,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:46,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary/_attempt_20131031202710049_0008_r_000000_0 dst=null perm=null
2013-10-31 20:31:46,785 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_r_000000_0 1.0% reduce > reduce
2013-10-31 20:31:46,788 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_r_000000_0 1.0% reduce > reduce
2013-10-31 20:31:46,789 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0008_r_000000_0 is done.
2013-10-31 20:31:46,789 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0008_r_000000_0 was -1
2013-10-31 20:31:46,789 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:48,366 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0008_r_000000_0' has completed task_20131031202710049_0008_r_000000 successfully.
2013-10-31 20:31:48,370 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0008_m_000001_0' to tip task_20131031202710049_0008_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:31:48,372 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0008_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:31:48,373 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0008_m_000001_0 which needs 1 slots
2013-10-31 20:31:48,373 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0008_m_000001_0 which needs 1 slots
2013-10-31 20:31:48,403 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0008/attempt_20131031202710049_0008_m_000001_0. Attempting to reuse: jvm_20131031202710049_0008_m_-184015594
2013-10-31 20:31:49,353 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0008_m_-184015594 given task: attempt_20131031202710049_0008_m_000001_0
2013-10-31 20:31:49,456 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_m_000001_0 0.0%
2013-10-31 20:31:49,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary dst=null perm=null
2013-10-31 20:31:49,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:49,490 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_SUCCESS from client DFSClient_attempt_20131031202710049_0008_m_000001_0
2013-10-31 20:31:49,491 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0008_m_000001_0
2013-10-31 20:31:49,497 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8039487278617192869 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:49,498 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8039487278617192869 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:49,498 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8039487278617192869 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:49,498 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8039487278617192869 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:49,498 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-840931425823280771 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:49,498 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-840931425823280771 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:49,499 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-840931425823280771 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:49,499 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-840931425823280771 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:49,499 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3869408726430639669 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:49,499 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3869408726430639669 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:49,499 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3869408726430639669 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:49,500 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-146153167274804708 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:49,500 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-146153167274804708 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:49,500 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-146153167274804708 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:49,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0008 dst=null perm=null
2013-10-31 20:31:52,428 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0008_m_000001_0 0.0% cleanup
2013-10-31 20:31:52,430 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0008_m_000001_0 is done.
2013-10-31 20:31:52,430 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0008_m_000001_0 was -1
2013-10-31 20:31:52,431 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:31:52,433 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-840931425823280771_1069 blk_8039487278617192869_1068
2013-10-31 20:31:52,433 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-146153167274804708_1071 blk_-840931425823280771_1069 blk_-3869408726430639669_1070 blk_8039487278617192869_1068
2013-10-31 20:31:53,373 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0008_r_000000_0
2013-10-31 20:31:53,373 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0008_r_000000_0
2013-10-31 20:31:53,826 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3869408726430639669_1070 file build/test/data/dfs/data/data2/current/blk_-3869408726430639669 for deletion
2013-10-31 20:31:53,826 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-840931425823280771_1069 file build/test/data/dfs/data/data1/current/blk_-840931425823280771 for deletion
2013-10-31 20:31:53,826 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3869408726430639669_1070 at file build/test/data/dfs/data/data2/current/blk_-3869408726430639669
2013-10-31 20:31:53,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-146153167274804708_1071 file build/test/data/dfs/data/data1/current/blk_-146153167274804708 for deletion
2013-10-31 20:31:53,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-840931425823280771_1069 at file build/test/data/dfs/data/data1/current/blk_-840931425823280771
2013-10-31 20:31:53,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8039487278617192869_1068 file build/test/data/dfs/data/data2/current/blk_8039487278617192869 for deletion
2013-10-31 20:31:53,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-146153167274804708_1071 at file build/test/data/dfs/data/data1/current/blk_-146153167274804708
2013-10-31 20:31:53,828 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8039487278617192869_1068 at file build/test/data/dfs/data/data2/current/blk_8039487278617192869
2013-10-31 20:31:54,273 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-840931425823280771_1069 file build/test/data/dfs/data/data3/current/blk_-840931425823280771 for deletion
2013-10-31 20:31:54,273 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8039487278617192869_1068 file build/test/data/dfs/data/data4/current/blk_8039487278617192869 for deletion
2013-10-31 20:31:54,273 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-840931425823280771_1069 at file build/test/data/dfs/data/data3/current/blk_-840931425823280771
2013-10-31 20:31:54,274 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8039487278617192869_1068 at file build/test/data/dfs/data/data4/current/blk_8039487278617192869
2013-10-31 20:31:54,379 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0008_m_000001_0' has completed task_20131031202710049_0008_m_000001 successfully.
2013-10-31 20:31:54,380 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0008 has completed successfully.
2013-10-31 20:31:54,380 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0008,submitTime=1383251484175,launchTime=1383251484303,firstMapTaskLaunchTime=1383251490340,firstReduceTaskLaunchTime=1383251496350,firstJobSetupTaskLaunchTime=1383251484327,firstJobCleanupTaskLaunchTime=1383251508370,finishTime=1383251514380,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5FE5D552DBE44D8B8859E538CE0C5AEC/D248D280774048DA93C551F11290A89B] lower*upper/(2/2) ...alue/true/true/true/false
2013-10-31 20:31:54,386 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_1383251484175_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2FD248D280774048DA. blk_-4086541134687009383_1076
2013-10-31 20:31:54,388 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4086541134687009383_1076 src: /127.0.0.1:34439 dest: /127.0.0.1:37249
2013-10-31 20:31:54,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4086541134687009383_1076 src: /127.0.0.1:44222 dest: /127.0.0.1:33202
2013-10-31 20:31:54,392 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4086541134687009383_1076 src: /127.0.0.1:35837 dest: /127.0.0.1:49827
2013-10-31 20:31:54,402 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35837, dest: /127.0.0.1:49827, bytes: 16942, op: HDFS_WRITE, cliID: DFSClient_683589222, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4086541134687009383_1076, duration: 6475067
2013-10-31 20:31:54,402 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4086541134687009383_1076 terminating
2013-10-31 20:31:54,403 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44222, dest: /127.0.0.1:33202, bytes: 16942, op: HDFS_WRITE, cliID: DFSClient_683589222, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4086541134687009383_1076, duration: 7969503
2013-10-31 20:31:54,404 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4086541134687009383_1076 size 16942
2013-10-31 20:31:54,404 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4086541134687009383_1076 terminating
2013-10-31 20:31:54,405 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34439, dest: /127.0.0.1:37249, bytes: 16942, op: HDFS_WRITE, cliID: DFSClient_683589222, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4086541134687009383_1076, duration: 7276733
2013-10-31 20:31:54,406 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4086541134687009383_1076 terminating
2013-10-31 20:31:54,408 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4086541134687009383_1076 size 16942
2013-10-31 20:31:54,409 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_1383251484175_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2FD248D280774048DA from client DFSClient_683589222
2013-10-31 20:31:54,409 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_logs/history/job_20131031202710049_0008_1383251484175_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2FD248D280774048DA is closed by DFSClient_683589222
2013-10-31 20:31:54,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4086541134687009383_1076 size 16942
2013-10-31 20:31:54,420 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0008_1383251484175_hadoop_%5B5FE5D552DBE44D8B8859E538CE0C5AEC%2FD248D280774048DA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:31:54,421 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0008_m_000000_0'
2013-10-31 20:31:54,421 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0008_m_000001_0'
2013-10-31 20:31:54,421 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0008_m_000002_0'
2013-10-31 20:31:54,421 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0008_r_000000_0'
2013-10-31 20:31:54,423 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9165694415457292386 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:54,423 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9165694415457292386 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:54,423 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9165694415457292386 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:54,429 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0008_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:31:54,430 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7419656928004317539 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:54,430 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7419656928004317539 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:31:54,430 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7419656928004317539 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:54,430 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4500649980417596560 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:54,431 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4500649980417596560 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:54,431 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4500649980417596560 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:54,431 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2943885495038914141 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:31:54,431 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2943885495038914141 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:31:54,432 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2943885495038914141 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:31:54,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0008 dst=null perm=null
2013-10-31 20:31:54,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8455100343_lower_upper_63DF9E14F9F04C84998C6D64CAB22BEA dst=null perm=null
2013-10-31 20:31:54,443 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/_temporary
2013-10-31 20:31:54,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false dst=null perm=null
2013-10-31 20:31:54,465 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:31:54,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/part-00000 dst=null perm=null
2013-10-31 20:31:54,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/part-00000 dst=null perm=null
2013-10-31 20:31:54,473 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35839, bytes: 1052, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6991253994306906579_1075, duration: 2130128
2013-10-31 20:31:54,474 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 90 raw values into 1 aggregated values, total 1
2013-10-31 20:31:54,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false dst=null perm=null
2013-10-31 20:31:54,494 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:31:54,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/part-00000 dst=null perm=null
2013-10-31 20:31:54,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/part-00000 dst=null perm=null
2013-10-31 20:31:54,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35840, bytes: 1052, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6991253994306906579_1075, duration: 412323
2013-10-31 20:31:54,499 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false
2013-10-31 20:31:54,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false dst=null perm=null
2013-10-31 20:31:54,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/false/part-00000 dst=null perm=null
2013-10-31 20:31:54,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39935, bytes: 1052, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6991253994306906579_1075, duration: 396474
2013-10-31 20:31:54,518 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:31:54,519 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:31:54,551 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:31:54,551 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:31:54,551 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:31:54,551 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false"]
2013-10-31 20:31:54,552 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:31:54,552 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:31:54,552 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:31:54,553 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:31:54,556 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:31:54,556 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:31:54,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:54,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:31:54,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,580 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar. blk_-4723970173738345539_1077
2013-10-31 20:31:54,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4723970173738345539_1077 src: /127.0.0.1:44228 dest: /127.0.0.1:33202
2013-10-31 20:31:54,583 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4723970173738345539_1077 src: /127.0.0.1:35843 dest: /127.0.0.1:49827
2013-10-31 20:31:54,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4723970173738345539_1077 src: /127.0.0.1:34448 dest: /127.0.0.1:37249
2013-10-31 20:31:54,593 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34448, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4723970173738345539_1077, duration: 4658899
2013-10-31 20:31:54,594 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4723970173738345539_1077 terminating
2013-10-31 20:31:54,595 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35843, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4723970173738345539_1077, duration: 6575349
2013-10-31 20:31:54,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4723970173738345539_1077 terminating
2013-10-31 20:31:54,596 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4723970173738345539_1077 size 238055
2013-10-31 20:31:54,597 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44228, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4723970173738345539_1077, duration: 8369009
2013-10-31 20:31:54,598 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4723970173738345539_1077 terminating
2013-10-31 20:31:54,599 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4723970173738345539_1077 size 238055
2013-10-31 20:31:54,599 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar from client DFSClient_848976415
2013-10-31 20:31:54,600 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar is closed by DFSClient_848976415
2013-10-31 20:31:54,600 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4723970173738345539_1077 size 238055
2013-10-31 20:31:54,605 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar. New replication is 10
2013-10-31 20:31:54,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar dst=null perm=null
2013-10-31 20:31:54,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,616 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:31:54,622 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:31:54,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:31:54,625 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:31:54,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:31:54,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,639 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split. New replication is 10
2013-10-31 20:31:54,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split dst=null perm=null
2013-10-31 20:31:54,644 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split. blk_8484553367909035636_1078
2013-10-31 20:31:54,645 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8484553367909035636_1078 src: /127.0.0.1:35846 dest: /127.0.0.1:49827
2013-10-31 20:31:54,646 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8484553367909035636_1078 src: /127.0.0.1:44233 dest: /127.0.0.1:33202
2013-10-31 20:31:54,647 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8484553367909035636_1078 src: /127.0.0.1:34452 dest: /127.0.0.1:37249
2013-10-31 20:31:54,649 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8484553367909035636_1078 src: /127.0.0.1:39943 dest: /127.0.0.1:46399
2013-10-31 20:31:54,652 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39943, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8484553367909035636_1078, duration: 2373832
2013-10-31 20:31:54,652 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8484553367909035636_1078 terminating
2013-10-31 20:31:54,653 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34452, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8484553367909035636_1078, duration: 1191593
2013-10-31 20:31:54,653 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8484553367909035636_1078 terminating
2013-10-31 20:31:54,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8484553367909035636_1078 size 697
2013-10-31 20:31:54,655 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44233, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8484553367909035636_1078, duration: 3701017
2013-10-31 20:31:54,655 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_8484553367909035636_1078 size 697
2013-10-31 20:31:54,655 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8484553367909035636_1078 terminating
2013-10-31 20:31:54,657 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35846, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8484553367909035636_1078, duration: 4546664
2013-10-31 20:31:54,659 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8484553367909035636_1078 terminating
2013-10-31 20:31:54,662 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8484553367909035636_1078 size 697
2013-10-31 20:31:54,664 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split from client DFSClient_848976415
2013-10-31 20:31:54,665 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split is closed by DFSClient_848976415
2013-10-31 20:31:54,665 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8484553367909035636_1078 size 697
2013-10-31 20:31:54,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,947 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.splitmetainfo. blk_-3925264537682707559_1079
2013-10-31 20:31:54,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3925264537682707559_1079 src: /127.0.0.1:35850 dest: /127.0.0.1:49827
2013-10-31 20:31:54,950 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3925264537682707559_1079 src: /127.0.0.1:34455 dest: /127.0.0.1:37249
2013-10-31 20:31:54,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3925264537682707559_1079 src: /127.0.0.1:44238 dest: /127.0.0.1:33202
2013-10-31 20:31:54,957 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44238, dest: /127.0.0.1:33202, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3925264537682707559_1079, duration: 729391
2013-10-31 20:31:54,958 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3925264537682707559_1079 terminating
2013-10-31 20:31:54,959 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34455, dest: /127.0.0.1:37249, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3925264537682707559_1079, duration: 2219847
2013-10-31 20:31:54,959 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3925264537682707559_1079 terminating
2013-10-31 20:31:54,960 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35850, dest: /127.0.0.1:49827, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3925264537682707559_1079, duration: 3900345
2013-10-31 20:31:54,960 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3925264537682707559_1079 size 78
2013-10-31 20:31:54,961 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3925264537682707559_1079 terminating
2013-10-31 20:31:54,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3925264537682707559_1079 size 78
2013-10-31 20:31:54,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-3925264537682707559_1079 size 78
2013-10-31 20:31:54,963 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:31:54,964 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:31:54,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:54,989 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml. blk_-1365030839145346734_1080
2013-10-31 20:31:54,991 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1365030839145346734_1080 src: /127.0.0.1:39947 dest: /127.0.0.1:46399
2013-10-31 20:31:54,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1365030839145346734_1080 src: /127.0.0.1:44240 dest: /127.0.0.1:33202
2013-10-31 20:31:54,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1365030839145346734_1080 src: /127.0.0.1:35855 dest: /127.0.0.1:49827
2013-10-31 20:31:54,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35855, dest: /127.0.0.1:49827, bytes: 29750, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1365030839145346734_1080, duration: 1622112
2013-10-31 20:31:54,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1365030839145346734_1080 terminating
2013-10-31 20:31:54,999 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44240, dest: /127.0.0.1:33202, bytes: 29750, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1365030839145346734_1080, duration: 2981311
2013-10-31 20:31:55,000 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1365030839145346734_1080 terminating
2013-10-31 20:31:55,001 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39947, dest: /127.0.0.1:46399, bytes: 29750, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1365030839145346734_1080, duration: 4484401
2013-10-31 20:31:55,001 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1365030839145346734_1080 terminating
2013-10-31 20:31:55,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1365030839145346734_1080 size 29750
2013-10-31 20:31:55,004 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1365030839145346734_1080 size 29750
2013-10-31 20:31:55,004 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1365030839145346734_1080 size 29750
2013-10-31 20:31:55,005 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml from client DFSClient_848976415
2013-10-31 20:31:55,005 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml is closed by DFSClient_848976415
2013-10-31 20:31:55,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml dst=null perm=null
2013-10-31 20:31:55,021 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44243, bytes: 29986, op: HDFS_READ, cliID: DFSClient_-423399123, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1365030839145346734_1080, duration: 397527
2013-10-31 20:31:55,041 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0009: nMaps=2 nReduces=1 max=-1
2013-10-31 20:31:55,041 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0009 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:31:55,041 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0009
2013-10-31 20:31:55,041 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0009 RESULT=SUCCESS
2013-10-31 20:31:55,042 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0009
2013-10-31 20:31:55,044 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0009
2013-10-31 20:31:55,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_1383251515011_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2FA9ABBFED74E14340 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:55,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:55,079 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_conf.xml. blk_-7428201871889901788_1082
2013-10-31 20:31:55,081 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428201871889901788_1082 src: /127.0.0.1:35858 dest: /127.0.0.1:49827
2013-10-31 20:31:55,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428201871889901788_1082 src: /127.0.0.1:34463 dest: /127.0.0.1:37249
2013-10-31 20:31:55,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428201871889901788_1082 src: /127.0.0.1:44246 dest: /127.0.0.1:33202
2013-10-31 20:31:55,092 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44246, dest: /127.0.0.1:33202, bytes: 29815, op: HDFS_WRITE, cliID: DFSClient_-423399123, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7428201871889901788_1082, duration: 4095555
2013-10-31 20:31:55,092 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7428201871889901788_1082 terminating
2013-10-31 20:31:55,093 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34463, dest: /127.0.0.1:37249, bytes: 29815, op: HDFS_WRITE, cliID: DFSClient_-423399123, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7428201871889901788_1082, duration: 5675329
2013-10-31 20:31:55,094 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7428201871889901788_1082 terminating
2013-10-31 20:31:55,095 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35858, dest: /127.0.0.1:49827, bytes: 29815, op: HDFS_WRITE, cliID: DFSClient_-423399123, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7428201871889901788_1082, duration: 7269502
2013-10-31 20:31:55,095 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7428201871889901788_1082 terminating
2013-10-31 20:31:55,095 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7428201871889901788_1082 size 29815
2013-10-31 20:31:55,097 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7428201871889901788_1082 size 29815
2013-10-31 20:31:55,097 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_conf.xml from client DFSClient_-423399123
2013-10-31 20:31:55,098 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_conf.xml is closed by DFSClient_-423399123
2013-10-31 20:31:55,099 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7428201871889901788_1082 size 29815
2013-10-31 20:31:55,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:31:55,110 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken. blk_-8394885687740365629_1083
2013-10-31 20:31:55,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8394885687740365629_1083 src: /127.0.0.1:39955 dest: /127.0.0.1:46399
2013-10-31 20:31:55,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8394885687740365629_1083 src: /127.0.0.1:35862 dest: /127.0.0.1:49827
2013-10-31 20:31:55,115 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8394885687740365629_1083 src: /127.0.0.1:44249 dest: /127.0.0.1:33202
2013-10-31 20:31:55,120 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44249, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8394885687740365629_1083, duration: 2012519
2013-10-31 20:31:55,120 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8394885687740365629_1083 terminating
2013-10-31 20:31:55,121 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35862, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8394885687740365629_1083, duration: 2819425
2013-10-31 20:31:55,121 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8394885687740365629_1083 terminating
2013-10-31 20:31:55,121 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8394885687740365629_1083 size 116
2013-10-31 20:31:55,122 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39955, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8394885687740365629_1083, duration: 3755914
2013-10-31 20:31:55,123 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8394885687740365629_1083 terminating
2013-10-31 20:31:55,128 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8394885687740365629_1083 size 116
2013-10-31 20:31:55,128 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken from client DFSClient_848976415
2013-10-31 20:31:55,128 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken is closed by DFSClient_848976415
2013-10-31 20:31:55,129 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8394885687740365629_1083 size 116
2013-10-31 20:31:55,132 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken
2013-10-31 20:31:55,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.splitmetainfo dst=null perm=null
2013-10-31 20:31:55,137 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34468, bytes: 82, op: HDFS_READ, cliID: DFSClient_-423399123, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3925264537682707559_1079, duration: 277448
2013-10-31 20:31:55,137 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0009 = 38. Number of splits = 2
2013-10-31 20:31:55,138 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:55,138 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:55,138 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:55,138 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:55,139 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:55,139 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:31:55,139 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0009 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:31:55,140 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0009 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:31:55,173 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0009_m_000003_0' to tip task_20131031202710049_0009_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:31:55,181 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0009_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:31:55,181 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0009_m_000003_0 which needs 1 slots
2013-10-31 20:31:55,181 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0008
2013-10-31 20:31:55,181 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0009_m_000003_0 which needs 1 slots
2013-10-31 20:31:55,181 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0008 being deleted.
2013-10-31 20:31:55,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken dst=null perm=null
2013-10-31 20:31:55,191 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35865, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8394885687740365629_1083, duration: 360966
2013-10-31 20:31:55,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml dst=null perm=null
2013-10-31 20:31:55,202 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44253, bytes: 29986, op: HDFS_READ, cliID: DFSClient_105959163, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1365030839145346734_1080, duration: 374464
2013-10-31 20:31:55,235 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:31:55,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar dst=null perm=null
2013-10-31 20:31:55,267 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35868, bytes: 239915, op: HDFS_READ, cliID: DFSClient_105959163, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4723970173738345539_1077, duration: 1133502
2013-10-31 20:31:55,398 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0009_m_773281432
2013-10-31 20:31:55,399 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0009_m_773281432 spawned.
2013-10-31 20:31:55,401 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0009/attempt_20131031202710049_0009_m_000003_0/taskjvm.sh
2013-10-31 20:31:55,434 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37249 to replicate blk_-4723970173738345539_1077 to datanode(s) 127.0.0.1:46399
2013-10-31 20:31:55,434 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_4500649980417596560_1064 blk_-7419656928004317539_1067 blk_9165694415457292386_1074 blk_2943885495038914141_1066
2013-10-31 20:31:55,434 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_4500649980417596560_1064 blk_-146153167274804708_1071 blk_-840931425823280771_1069 blk_-3869408726430639669_1070 blk_8039487278617192869_1068 blk_9165694415457292386_1074 blk_2943885495038914141_1066
2013-10-31 20:31:56,664 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0008
2013-10-31 20:31:56,664 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0008 being deleted.
2013-10-31 20:31:56,680 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0009_m_773281432 given task: attempt_20131031202710049_0009_m_000003_0
2013-10-31 20:31:56,826 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642) Starting thread to transfer block blk_-4723970173738345539_1077 to 127.0.0.1:46399
2013-10-31 20:31:56,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4723970173738345539_1077 src: /127.0.0.1:39964 dest: /127.0.0.1:46399
2013-10-31 20:31:56,827 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642):Transmitted block blk_-4723970173738345539_1077 to /127.0.0.1:46399
2013-10-31 20:31:56,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4723970173738345539_1077 src: /127.0.0.1:39964 dest: /127.0.0.1:46399 of size 238055
2013-10-31 20:31:56,831 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4723970173738345539_1077 size 238055
2013-10-31 20:31:57,157 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0008
2013-10-31 20:31:57,157 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0008 being deleted.
2013-10-31 20:31:57,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:31:57,274 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7419656928004317539_1067 file build/test/data/dfs/data/data3/current/blk_-7419656928004317539 for deletion
2013-10-31 20:31:57,274 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2943885495038914141_1066 file build/test/data/dfs/data/data4/current/blk_2943885495038914141 for deletion
2013-10-31 20:31:57,274 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7419656928004317539_1067 at file build/test/data/dfs/data/data3/current/blk_-7419656928004317539
2013-10-31 20:31:57,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4500649980417596560_1064 file build/test/data/dfs/data/data4/current/blk_4500649980417596560 for deletion
2013-10-31 20:31:57,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2943885495038914141_1066 at file build/test/data/dfs/data/data4/current/blk_2943885495038914141
2013-10-31 20:31:57,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9165694415457292386_1074 file build/test/data/dfs/data/data3/current/blk_9165694415457292386 for deletion
2013-10-31 20:31:57,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4500649980417596560_1064 at file build/test/data/dfs/data/data4/current/blk_4500649980417596560
2013-10-31 20:31:57,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9165694415457292386_1074 at file build/test/data/dfs/data/data3/current/blk_9165694415457292386
2013-10-31 20:31:58,100 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3869408726430639669_1070 file build/test/data/dfs/data/data8/current/blk_-3869408726430639669 for deletion
2013-10-31 20:31:58,100 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-840931425823280771_1069 file build/test/data/dfs/data/data7/current/blk_-840931425823280771 for deletion
2013-10-31 20:31:58,100 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3869408726430639669_1070 at file build/test/data/dfs/data/data8/current/blk_-3869408726430639669
2013-10-31 20:31:58,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-146153167274804708_1071 file build/test/data/dfs/data/data7/current/blk_-146153167274804708 for deletion
2013-10-31 20:31:58,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-840931425823280771_1069 at file build/test/data/dfs/data/data7/current/blk_-840931425823280771
2013-10-31 20:31:58,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2943885495038914141_1066 file build/test/data/dfs/data/data8/current/blk_2943885495038914141 for deletion
2013-10-31 20:31:58,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-146153167274804708_1071 at file build/test/data/dfs/data/data7/current/blk_-146153167274804708
2013-10-31 20:31:58,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4500649980417596560_1064 file build/test/data/dfs/data/data7/current/blk_4500649980417596560 for deletion
2013-10-31 20:31:58,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2943885495038914141_1066 at file build/test/data/dfs/data/data8/current/blk_2943885495038914141
2013-10-31 20:31:58,102 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4500649980417596560_1064 at file build/test/data/dfs/data/data7/current/blk_4500649980417596560
2013-10-31 20:31:58,102 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8039487278617192869_1068 file build/test/data/dfs/data/data8/current/blk_8039487278617192869 for deletion
2013-10-31 20:31:58,102 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9165694415457292386_1074 file build/test/data/dfs/data/data7/current/blk_9165694415457292386 for deletion
2013-10-31 20:31:58,103 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9165694415457292386_1074 at file build/test/data/dfs/data/data7/current/blk_9165694415457292386
2013-10-31 20:31:58,103 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8039487278617192869_1068 at file build/test/data/dfs/data/data8/current/blk_8039487278617192869
2013-10-31 20:31:58,435 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_4500649980417596560_1064 blk_-146153167274804708_1071 blk_-7419656928004317539_1067 blk_-840931425823280771_1069 blk_-3869408726430639669_1070 blk_8039487278617192869_1068 blk_9165694415457292386_1074 blk_2943885495038914141_1066
2013-10-31 20:31:58,436 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-7419656928004317539_1067
2013-10-31 20:31:59,423 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0008
2013-10-31 20:31:59,423 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0008_m_000001_0 not found in cache
2013-10-31 20:31:59,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0008 for user-log deletion with retainTimeStamp:1383337919424
2013-10-31 20:31:59,828 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7419656928004317539_1067 file build/test/data/dfs/data/data1/current/blk_-7419656928004317539 for deletion
2013-10-31 20:31:59,828 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7419656928004317539_1067 at file build/test/data/dfs/data/data1/current/blk_-7419656928004317539
2013-10-31 20:32:00,097 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_m_000003_0 0.0% setup
2013-10-31 20:32:00,100 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0009_m_000003_0 is done.
2013-10-31 20:32:00,100 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0009_m_000003_0 was -1
2013-10-31 20:32:00,100 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:00,469 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0008_m_-184015594 since job job_20131031202710049_0008 is dead
2013-10-31 20:32:00,479 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29586 with signal TERM. Exit code 0
2013-10-31 20:32:00,686 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:00,686 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:00,686 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:00,687 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0008_m_-184015594 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:32:00,714 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0008_m_829744483 since job job_20131031202710049_0008 is dead
2013-10-31 20:32:00,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7419656928004317539_1067 file build/test/data/dfs/data/data6/current/blk_-7419656928004317539 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3869408726430639669_1070 file build/test/data/dfs/data/data5/current/blk_-3869408726430639669 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-840931425823280771_1069 file build/test/data/dfs/data/data6/current/blk_-840931425823280771 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-146153167274804708_1071 file build/test/data/dfs/data/data6/current/blk_-146153167274804708 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2943885495038914141_1066 file build/test/data/dfs/data/data5/current/blk_2943885495038914141 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4500649980417596560_1064 file build/test/data/dfs/data/data5/current/blk_4500649980417596560 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8039487278617192869_1068 file build/test/data/dfs/data/data5/current/blk_8039487278617192869 for deletion
2013-10-31 20:32:00,719 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9165694415457292386_1074 file build/test/data/dfs/data/data5/current/blk_9165694415457292386 for deletion
2013-10-31 20:32:00,721 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29703 with signal TERM. Exit code 0
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3869408726430639669_1070 at file build/test/data/dfs/data/data5/current/blk_-3869408726430639669
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7419656928004317539_1067 at file build/test/data/dfs/data/data6/current/blk_-7419656928004317539
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2943885495038914141_1066 at file build/test/data/dfs/data/data5/current/blk_2943885495038914141
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-840931425823280771_1069 at file build/test/data/dfs/data/data6/current/blk_-840931425823280771
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4500649980417596560_1064 at file build/test/data/dfs/data/data5/current/blk_4500649980417596560
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-146153167274804708_1071 at file build/test/data/dfs/data/data6/current/blk_-146153167274804708
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8039487278617192869_1068 at file build/test/data/dfs/data/data5/current/blk_8039487278617192869
2013-10-31 20:32:00,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9165694415457292386_1074 at file build/test/data/dfs/data/data5/current/blk_9165694415457292386
2013-10-31 20:32:00,830 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0008_r_-693547091 since job job_20131031202710049_0008 is dead
2013-10-31 20:32:00,840 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29785 with signal TERM. Exit code 0
2013-10-31 20:32:01,001 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:01,002 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:01,002 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:01,002 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0008_r_-693547091 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:32:01,004 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:01,004 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:01,004 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:01,004 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0008_m_829744483 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:32:01,186 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0009_m_000003_0' has completed task_20131031202710049_0009_m_000003 successfully.
2013-10-31 20:32:01,189 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0009_m_000000_0' to tip task_20131031202710049_0009_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:32:01,190 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0009_m_000000
2013-10-31 20:32:01,191 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0009_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:32:01,191 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0009_m_000000_0 which needs 1 slots
2013-10-31 20:32:01,192 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0009_m_000000_0 which needs 1 slots
2013-10-31 20:32:01,237 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0009_m_-1802887264
2013-10-31 20:32:01,237 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0009_m_-1802887264 spawned.
2013-10-31 20:32:01,241 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0009/attempt_20131031202710049_0009_m_000000_0/taskjvm.sh
2013-10-31 20:32:02,083 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0009_m_-1802887264 given task: attempt_20131031202710049_0009_m_000000_0
2013-10-31 20:32:02,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split dst=null perm=null
2013-10-31 20:32:02,617 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35874, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0009_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8484553367909035636_1078, duration: 379578
2013-10-31 20:32:02,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:32:02,670 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0009_m_000001_0' to tip task_20131031202710049_0009_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:32:02,670 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0009_m_000001
2013-10-31 20:32:02,672 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0009_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:32:02,672 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0009_m_000001_0 which needs 1 slots
2013-10-31 20:32:02,672 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0009_m_000001_0 which needs 1 slots
2013-10-31 20:32:02,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009/jobToken dst=null perm=null
2013-10-31 20:32:02,678 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35875, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8394885687740365629_1083, duration: 264176
2013-10-31 20:32:02,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.xml dst=null perm=null
2013-10-31 20:32:02,685 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39971, bytes: 29986, op: HDFS_READ, cliID: DFSClient_-1233520560, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1365030839145346734_1080, duration: 386086
2013-10-31 20:32:02,705 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:32:02,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.jar dst=null perm=null
2013-10-31 20:32:02,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39972, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1233520560, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4723970173738345539_1077, duration: 657997
2013-10-31 20:32:02,789 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0009_m_993114345
2013-10-31 20:32:02,790 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0009_m_993114345 spawned.
2013-10-31 20:32:02,791 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0009/attempt_20131031202710049_0009_m_000001_0/taskjvm.sh
2013-10-31 20:32:03,195 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39973, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0009_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 135404
2013-10-31 20:32:03,964 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0009_m_993114345 given task: attempt_20131031202710049_0009_m_000001_0
2013-10-31 20:32:04,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009/job.split dst=null perm=null
2013-10-31 20:32:04,502 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:39976, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0009_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8484553367909035636_1078, duration: 223693
2013-10-31 20:32:04,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:32:04,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35883, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0009_m_000001_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 106150
2013-10-31 20:32:05,540 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:32:05,542 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0009_m_000000_0 is done.
2013-10-31 20:32:05,543 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0009_m_000000_0 was 335
2013-10-31 20:32:05,543 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:06,192 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0009_m_000003_0
2013-10-31 20:32:06,192 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0009_m_000003_0
2013-10-31 20:32:06,192 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0009_m_000003_0 not found in cache
2013-10-31 20:32:07,197 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0009_m_000000_0' has completed task_20131031202710049_0009_m_000000 successfully.
2013-10-31 20:32:07,200 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0009_r_000000_0' to tip task_20131031202710049_0009_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:32:07,202 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0009_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:32:07,203 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0009_r_000000_0 which needs 1 slots
2013-10-31 20:32:07,203 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0009_r_000000_0 which needs 1 slots
2013-10-31 20:32:07,237 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0009_r_-781670435
2013-10-31 20:32:07,237 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0009_r_-781670435 spawned.
2013-10-31 20:32:07,239 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0009/attempt_20131031202710049_0009_r_000000_0/taskjvm.sh
2013-10-31 20:32:07,433 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:32:07,435 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0009_m_000001_0 is done.
2013-10-31 20:32:07,436 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0009_m_000001_0 was 335
2013-10-31 20:32:07,436 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:08,043 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:32:08,053 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:32:08,061 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:32:08,069 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:32:08,074 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:32:08,080 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:32:08,085 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:32:08,085 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:32:08,303 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0009_r_-781670435 given task: attempt_20131031202710049_0009_r_000000_0
2013-10-31 20:32:08,675 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0009_m_000001_0' has completed task_20131031202710049_0009_m_000001 successfully.
2013-10-31 20:32:14,008 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53156, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0009_m_000000_0, duration: 10798190
2013-10-31 20:32:14,036 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53531, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0009_m_000001_0, duration: 13203715
2013-10-31 20:32:14,787 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:32:14,848 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:32:14,926 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:32:15,131 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 20:32:15,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:15,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:15,187 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0/part-00000. blk_-449800296977096095_1084
2013-10-31 20:32:15,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-449800296977096095_1084 src: /127.0.0.1:34492 dest: /127.0.0.1:37249
2013-10-31 20:32:15,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-449800296977096095_1084 src: /127.0.0.1:44275 dest: /127.0.0.1:33202
2013-10-31 20:32:15,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-449800296977096095_1084 src: /127.0.0.1:35890 dest: /127.0.0.1:49827
2013-10-31 20:32:15,231 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35890, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0009_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-449800296977096095_1084, duration: 4141820
2013-10-31 20:32:15,231 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-449800296977096095_1084 terminating
2013-10-31 20:32:15,231 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44275, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0009_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-449800296977096095_1084, duration: 4852487
2013-10-31 20:32:15,232 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-449800296977096095_1084 terminating
2013-10-31 20:32:15,232 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34492, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0009_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-449800296977096095_1084, duration: 5418205
2013-10-31 20:32:15,232 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-449800296977096095_1084 terminating
2013-10-31 20:32:15,236 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-449800296977096095_1084 size 708
2013-10-31 20:32:15,236 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0009_r_000000_0
2013-10-31 20:32:15,236 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0009_r_000000_0
2013-10-31 20:32:15,236 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-449800296977096095_1084 size 708
2013-10-31 20:32:15,236 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-449800296977096095_1084 size 708
2013-10-31 20:32:15,278 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0009_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:32:15,278 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:32:16,212 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0009_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:32:16,213 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0009_r_000000_0
2013-10-31 20:32:16,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0 dst=null perm=null
2013-10-31 20:32:16,287 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 447 Total time for transactions(ms): 11Number of transactions batched in Syncs: 15 Number of syncs: 303 SyncTimes(ms): 6713 1280
2013-10-31 20:32:16,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:16,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:16,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary/_attempt_20131031202710049_0009_r_000000_0 dst=null perm=null
2013-10-31 20:32:17,847 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_r_000000_0 1.0% reduce > reduce
2013-10-31 20:32:17,849 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_r_000000_0 1.0% reduce > reduce
2013-10-31 20:32:17,850 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0009_r_000000_0 is done.
2013-10-31 20:32:17,851 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0009_r_000000_0 was -1
2013-10-31 20:32:17,851 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:19,216 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0009_r_000000_0' has completed task_20131031202710049_0009_r_000000 successfully.
2013-10-31 20:32:19,220 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0009_m_000002_0' to tip task_20131031202710049_0009_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:32:19,223 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0009_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:32:19,223 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0009_m_000002_0 which needs 1 slots
2013-10-31 20:32:19,223 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0009_m_000002_0 which needs 1 slots
2013-10-31 20:32:19,259 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0009/attempt_20131031202710049_0009_m_000002_0. Attempting to reuse: jvm_20131031202710049_0009_m_773281432
2013-10-31 20:32:20,186 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0009_m_773281432 given task: attempt_20131031202710049_0009_m_000002_0
2013-10-31 20:32:20,296 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_m_000002_0 0.0%
2013-10-31 20:32:20,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_temporary dst=null perm=null
2013-10-31 20:32:20,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:20,416 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_SUCCESS from client DFSClient_attempt_20131031202710049_0009_m_000002_0
2013-10-31 20:32:20,416 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0009_m_000002_0
2013-10-31 20:32:20,456 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4723970173738345539 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:20,457 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4723970173738345539 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:20,457 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4723970173738345539 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:20,457 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4723970173738345539 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:20,457 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8484553367909035636 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:20,458 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8484553367909035636 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:20,458 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8484553367909035636 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:20,458 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8484553367909035636 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:20,458 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3925264537682707559 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:20,459 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3925264537682707559 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:20,459 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3925264537682707559 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:20,459 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1365030839145346734 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:20,459 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1365030839145346734 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:20,459 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1365030839145346734 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:20,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0009 dst=null perm=null
2013-10-31 20:32:22,440 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-4723970173738345539_1077 blk_-1365030839145346734_1080 blk_8484553367909035636_1078
2013-10-31 20:32:22,440 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-4723970173738345539_1077 blk_-3925264537682707559_1079 blk_-1365030839145346734_1080 blk_8484553367909035636_1078
2013-10-31 20:32:23,267 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0009_m_000002_0 0.0% cleanup
2013-10-31 20:32:23,269 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0009_m_000002_0 is done.
2013-10-31 20:32:23,269 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0009_m_000002_0 was -1
2013-10-31 20:32:23,270 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:24,223 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0009_r_000000_0
2013-10-31 20:32:24,224 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0009_r_000000_0
2013-10-31 20:32:24,727 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4723970173738345539_1077 file build/test/data/dfs/data/data6/current/blk_-4723970173738345539 for deletion
2013-10-31 20:32:24,727 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1365030839145346734_1080 file build/test/data/dfs/data/data6/current/blk_-1365030839145346734 for deletion
2013-10-31 20:32:24,727 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4723970173738345539_1077 at file build/test/data/dfs/data/data6/current/blk_-4723970173738345539
2013-10-31 20:32:24,727 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8484553367909035636_1078 file build/test/data/dfs/data/data5/current/blk_8484553367909035636 for deletion
2013-10-31 20:32:24,728 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1365030839145346734_1080 at file build/test/data/dfs/data/data6/current/blk_-1365030839145346734
2013-10-31 20:32:24,728 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8484553367909035636_1078 at file build/test/data/dfs/data/data5/current/blk_8484553367909035636
2013-10-31 20:32:25,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4723970173738345539_1077 file build/test/data/dfs/data/data7/current/blk_-4723970173738345539 for deletion
2013-10-31 20:32:25,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3925264537682707559_1079 file build/test/data/dfs/data/data7/current/blk_-3925264537682707559 for deletion
2013-10-31 20:32:25,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4723970173738345539_1077 at file build/test/data/dfs/data/data7/current/blk_-4723970173738345539
2013-10-31 20:32:25,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1365030839145346734_1080 file build/test/data/dfs/data/data8/current/blk_-1365030839145346734 for deletion
2013-10-31 20:32:25,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3925264537682707559_1079 at file build/test/data/dfs/data/data7/current/blk_-3925264537682707559
2013-10-31 20:32:25,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8484553367909035636_1078 file build/test/data/dfs/data/data8/current/blk_8484553367909035636 for deletion
2013-10-31 20:32:25,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1365030839145346734_1080 at file build/test/data/dfs/data/data8/current/blk_-1365030839145346734
2013-10-31 20:32:25,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8484553367909035636_1078 at file build/test/data/dfs/data/data8/current/blk_8484553367909035636
2013-10-31 20:32:25,230 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0009_m_000002_0' has completed task_20131031202710049_0009_m_000002 successfully.
2013-10-31 20:32:25,231 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0009 has completed successfully.
2013-10-31 20:32:25,232 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0009,submitTime=1383251515011,launchTime=1383251515139,firstMapTaskLaunchTime=1383251521189,firstReduceTaskLaunchTime=1383251527199,firstJobSetupTaskLaunchTime=1383251515173,firstJobCleanupTaskLaunchTime=1383251539220,finishTime=1383251545231,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=17,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[72633E7DC6A24FA88B7D2EADF9ABB1AE/A9ABBFED74E14340929B3536CBFD333E] lower*upper/(1/2)
2013-10-31 20:32:25,241 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_1383251515011_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2FA9ABBFED74E14340. blk_-1791529231798605238_1085
2013-10-31 20:32:25,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1791529231798605238_1085 src: /127.0.0.1:39988 dest: /127.0.0.1:46399
2013-10-31 20:32:25,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1791529231798605238_1085 src: /127.0.0.1:35895 dest: /127.0.0.1:49827
2013-10-31 20:32:25,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1791529231798605238_1085 src: /127.0.0.1:34500 dest: /127.0.0.1:37249
2013-10-31 20:32:25,261 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34500, dest: /127.0.0.1:37249, bytes: 20678, op: HDFS_WRITE, cliID: DFSClient_-423399123, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1791529231798605238_1085, duration: 4549915
2013-10-31 20:32:25,261 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1791529231798605238_1085 terminating
2013-10-31 20:32:25,262 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35895, dest: /127.0.0.1:49827, bytes: 20678, op: HDFS_WRITE, cliID: DFSClient_-423399123, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1791529231798605238_1085, duration: 5650600
2013-10-31 20:32:25,263 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1791529231798605238_1085 size 20678
2013-10-31 20:32:25,263 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1791529231798605238_1085 terminating
2013-10-31 20:32:25,264 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39988, dest: /127.0.0.1:46399, bytes: 20678, op: HDFS_WRITE, cliID: DFSClient_-423399123, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1791529231798605238_1085, duration: 8931986
2013-10-31 20:32:25,264 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1791529231798605238_1085 size 20678
2013-10-31 20:32:25,265 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1791529231798605238_1085 terminating
2013-10-31 20:32:25,266 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_1383251515011_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2FA9ABBFED74E14340 from client DFSClient_-423399123
2013-10-31 20:32:25,267 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/_logs/history/job_20131031202710049_0009_1383251515011_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2FA9ABBFED74E14340 is closed by DFSClient_-423399123
2013-10-31 20:32:25,267 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1791529231798605238_1085 size 20678
2013-10-31 20:32:25,275 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0009_1383251515011_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2FA9ABBFED74E14340 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:32:25,275 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0009_m_000000_0'
2013-10-31 20:32:25,276 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0009_m_000002_0'
2013-10-31 20:32:25,276 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0009_m_000003_0'
2013-10-31 20:32:25,276 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0009_r_000000_0'
2013-10-31 20:32:25,277 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8394885687740365629 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:25,277 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8394885687740365629 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:25,278 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8394885687740365629 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:25,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...ue/false/true/false/false
2013-10-31 20:32:25,282 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0009_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:32:25,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0009 dst=null perm=null
2013-10-31 20:32:25,288 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:32:25,288 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:32:25,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:25,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:32:25,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,311 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar. blk_3700500589593143814_1086
2013-10-31 20:32:25,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3700500589593143814_1086 src: /127.0.0.1:35898 dest: /127.0.0.1:49827
2013-10-31 20:32:25,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3700500589593143814_1086 src: /127.0.0.1:39993 dest: /127.0.0.1:46399
2013-10-31 20:32:25,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3700500589593143814_1086 src: /127.0.0.1:34504 dest: /127.0.0.1:37249
2013-10-31 20:32:25,324 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34504, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3700500589593143814_1086, duration: 4837306
2013-10-31 20:32:25,324 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3700500589593143814_1086 terminating
2013-10-31 20:32:25,325 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39993, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3700500589593143814_1086, duration: 6843033
2013-10-31 20:32:25,326 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3700500589593143814_1086 terminating
2013-10-31 20:32:25,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3700500589593143814_1086 size 238055
2013-10-31 20:32:25,328 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35898, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3700500589593143814_1086, duration: 8531671
2013-10-31 20:32:25,328 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3700500589593143814_1086 terminating
2013-10-31 20:32:25,329 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3700500589593143814_1086 size 238055
2013-10-31 20:32:25,330 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar from client DFSClient_848976415
2013-10-31 20:32:25,330 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar is closed by DFSClient_848976415
2013-10-31 20:32:25,331 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3700500589593143814_1086 size 238055
2013-10-31 20:32:25,335 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar. New replication is 10
2013-10-31 20:32:25,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar dst=null perm=null
2013-10-31 20:32:25,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,347 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:32:25,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF dst=null perm=null
2013-10-31 20:32:25,353 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:32:25,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/part-00000 dst=null perm=null
2013-10-31 20:32:25,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,371 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split. New replication is 10
2013-10-31 20:32:25,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split dst=null perm=null
2013-10-31 20:32:25,378 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split. blk_-2587470771615567516_1087
2013-10-31 20:32:25,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2587470771615567516_1087 src: /127.0.0.1:39995 dest: /127.0.0.1:46399
2013-10-31 20:32:25,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2587470771615567516_1087 src: /127.0.0.1:35902 dest: /127.0.0.1:49827
2013-10-31 20:32:25,383 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2587470771615567516_1087 src: /127.0.0.1:44289 dest: /127.0.0.1:33202
2013-10-31 20:32:25,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2587470771615567516_1087 src: /127.0.0.1:34508 dest: /127.0.0.1:37249
2013-10-31 20:32:25,389 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34508, dest: /127.0.0.1:37249, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2587470771615567516_1087, duration: 859822
2013-10-31 20:32:25,389 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2587470771615567516_1087 terminating
2013-10-31 20:32:25,390 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44289, dest: /127.0.0.1:33202, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-2587470771615567516_1087, duration: 2463811
2013-10-31 20:32:25,391 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2587470771615567516_1087 terminating
2013-10-31 20:32:25,392 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35902, dest: /127.0.0.1:49827, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2587470771615567516_1087, duration: 4017518
2013-10-31 20:32:25,392 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-2587470771615567516_1087 size 357
2013-10-31 20:32:25,392 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2587470771615567516_1087 terminating
2013-10-31 20:32:25,394 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:39995, dest: /127.0.0.1:46399, bytes: 357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2587470771615567516_1087, duration: 5798232
2013-10-31 20:32:25,394 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-2587470771615567516_1087 size 357
2013-10-31 20:32:25,395 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2587470771615567516_1087 terminating
2013-10-31 20:32:25,397 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-2587470771615567516_1087 size 357
2013-10-31 20:32:25,402 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split from client DFSClient_848976415
2013-10-31 20:32:25,402 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split is closed by DFSClient_848976415
2013-10-31 20:32:25,402 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-2587470771615567516_1087 size 357
2013-10-31 20:32:25,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,441 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37249 to replicate blk_3700500589593143814_1086 to datanode(s) 127.0.0.1:33202
2013-10-31 20:32:25,441 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-4723970173738345539_1077 blk_-3925264537682707559_1079 blk_-1365030839145346734_1080 blk_-8394885687740365629_1083 blk_8484553367909035636_1078
2013-10-31 20:32:25,441 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-4723970173738345539_1077 blk_-3925264537682707559_1079 blk_8484553367909035636_1078
2013-10-31 20:32:25,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,697 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.splitmetainfo. blk_5089405292572100631_1088
2013-10-31 20:32:25,699 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5089405292572100631_1088 src: /127.0.0.1:34510 dest: /127.0.0.1:37249
2013-10-31 20:32:25,701 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5089405292572100631_1088 src: /127.0.0.1:40001 dest: /127.0.0.1:46399
2013-10-31 20:32:25,703 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5089405292572100631_1088 src: /127.0.0.1:44294 dest: /127.0.0.1:33202
2013-10-31 20:32:25,709 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44294, dest: /127.0.0.1:33202, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5089405292572100631_1088, duration: 3804865
2013-10-31 20:32:25,710 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5089405292572100631_1088 terminating
2013-10-31 20:32:25,711 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40001, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5089405292572100631_1088, duration: 5129174
2013-10-31 20:32:25,711 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5089405292572100631_1088 terminating
2013-10-31 20:32:25,713 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34510, dest: /127.0.0.1:37249, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_5089405292572100631_1088, duration: 6947522
2013-10-31 20:32:25,713 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5089405292572100631_1088 size 45
2013-10-31 20:32:25,713 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5089405292572100631_1088 terminating
2013-10-31 20:32:25,717 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5089405292572100631_1088 size 45
2013-10-31 20:32:25,717 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:32:25,718 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:32:25,718 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_5089405292572100631_1088 size 45
2013-10-31 20:32:25,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:25,809 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml. blk_6202780330174234313_1089
2013-10-31 20:32:25,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6202780330174234313_1089 src: /127.0.0.1:40003 dest: /127.0.0.1:46399
2013-10-31 20:32:25,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6202780330174234313_1089 src: /127.0.0.1:34514 dest: /127.0.0.1:37249
2013-10-31 20:32:25,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6202780330174234313_1089 src: /127.0.0.1:35911 dest: /127.0.0.1:49827
2013-10-31 20:32:25,832 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35911, dest: /127.0.0.1:49827, bytes: 29673, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6202780330174234313_1089, duration: 830598
2013-10-31 20:32:25,832 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6202780330174234313_1089 terminating
2013-10-31 20:32:25,834 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34514, dest: /127.0.0.1:37249, bytes: 29673, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6202780330174234313_1089, duration: 2308545
2013-10-31 20:32:25,834 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6202780330174234313_1089 terminating
2013-10-31 20:32:25,835 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40003, dest: /127.0.0.1:46399, bytes: 29673, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6202780330174234313_1089, duration: 3928166
2013-10-31 20:32:25,836 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6202780330174234313_1089 terminating
2013-10-31 20:32:25,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6202780330174234313_1089 size 29673
2013-10-31 20:32:25,837 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6202780330174234313_1089 size 29673
2013-10-31 20:32:25,838 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml from client DFSClient_848976415
2013-10-31 20:32:25,838 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml is closed by DFSClient_848976415
2013-10-31 20:32:25,839 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6202780330174234313_1089 size 29673
2013-10-31 20:32:25,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml dst=null perm=null
2013-10-31 20:32:25,859 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34517, bytes: 29905, op: HDFS_READ, cliID: DFSClient_1179902549, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6202780330174234313_1089, duration: 455386
2013-10-31 20:32:25,875 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0010: nMaps=1 nReduces=1 max=-1
2013-10-31 20:32:25,875 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0010 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:32:25,875 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0010
2013-10-31 20:32:25,875 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0010 RESULT=SUCCESS
2013-10-31 20:32:25,875 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0010
2013-10-31 20:32:25,877 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0010
2013-10-31 20:32:26,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_1383251545848_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2F3E2375243CE249BE dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:26,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:26,080 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_conf.xml. blk_-1386122454057140527_1091
2013-10-31 20:32:26,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1386122454057140527_1091 src: /127.0.0.1:40008 dest: /127.0.0.1:46399
2013-10-31 20:32:26,081 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1386122454057140527_1091 src: /127.0.0.1:34519 dest: /127.0.0.1:37249
2013-10-31 20:32:26,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1386122454057140527_1091 src: /127.0.0.1:44302 dest: /127.0.0.1:33202
2013-10-31 20:32:26,086 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44302, dest: /127.0.0.1:33202, bytes: 29738, op: HDFS_WRITE, cliID: DFSClient_1179902549, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1386122454057140527_1091, duration: 736495
2013-10-31 20:32:26,086 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1386122454057140527_1091 terminating
2013-10-31 20:32:26,088 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34519, dest: /127.0.0.1:37249, bytes: 29738, op: HDFS_WRITE, cliID: DFSClient_1179902549, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1386122454057140527_1091, duration: 2370925
2013-10-31 20:32:26,088 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1386122454057140527_1091 terminating
2013-10-31 20:32:26,089 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40008, dest: /127.0.0.1:46399, bytes: 29738, op: HDFS_WRITE, cliID: DFSClient_1179902549, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1386122454057140527_1091, duration: 3823458
2013-10-31 20:32:26,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1386122454057140527_1091 terminating
2013-10-31 20:32:26,089 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1386122454057140527_1091 size 29738
2013-10-31 20:32:26,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1386122454057140527_1091 size 29738
2013-10-31 20:32:26,092 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1386122454057140527_1091 size 29738
2013-10-31 20:32:26,092 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_conf.xml from client DFSClient_1179902549
2013-10-31 20:32:26,092 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_conf.xml is closed by DFSClient_1179902549
2013-10-31 20:32:26,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:26,105 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010/jobToken. blk_-8554828930916166671_1092
2013-10-31 20:32:26,106 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828930916166671_1092 src: /127.0.0.1:44303 dest: /127.0.0.1:33202
2013-10-31 20:32:26,108 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828930916166671_1092 src: /127.0.0.1:34522 dest: /127.0.0.1:37249
2013-10-31 20:32:26,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828930916166671_1092 src: /127.0.0.1:40013 dest: /127.0.0.1:46399
2013-10-31 20:32:26,114 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40013, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8554828930916166671_1092, duration: 2271791
2013-10-31 20:32:26,114 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8554828930916166671_1092 terminating
2013-10-31 20:32:26,115 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34522, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8554828930916166671_1092, duration: 3142016
2013-10-31 20:32:26,115 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8554828930916166671_1092 terminating
2013-10-31 20:32:26,115 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8554828930916166671_1092 size 116
2013-10-31 20:32:26,116 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44303, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8554828930916166671_1092, duration: 4158129
2013-10-31 20:32:26,116 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8554828930916166671_1092 size 116
2013-10-31 20:32:26,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8554828930916166671_1092 terminating
2013-10-31 20:32:26,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8554828930916166671_1092 size 116
2013-10-31 20:32:26,125 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010/jobToken from client DFSClient_848976415
2013-10-31 20:32:26,125 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010/jobToken is closed by DFSClient_848976415
2013-10-31 20:32:26,130 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010/jobToken
2013-10-31 20:32:26,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.splitmetainfo dst=null perm=null
2013-10-31 20:32:26,135 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34524, bytes: 49, op: HDFS_READ, cliID: DFSClient_1179902549, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_5089405292572100631_1088, duration: 331508
2013-10-31 20:32:26,135 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0010 = 708. Number of splits = 1
2013-10-31 20:32:26,135 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:26,136 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:26,136 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:26,136 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0010 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:32:26,137 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0010 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:32:26,697 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0010_m_000002_0' to tip task_20131031202710049_0010_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:32:26,703 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0009_m_000001_0'
2013-10-31 20:32:26,705 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0010_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:32:26,705 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0010_m_000002_0 which needs 1 slots
2013-10-31 20:32:26,706 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0010_m_000002_0 which needs 1 slots
2013-10-31 20:32:26,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010/jobToken dst=null perm=null
2013-10-31 20:32:26,714 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40015, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8554828930916166671_1092, duration: 267955
2013-10-31 20:32:26,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.xml dst=null perm=null
2013-10-31 20:32:26,725 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35923, bytes: 29905, op: HDFS_READ, cliID: DFSClient_974945305, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6202780330174234313_1089, duration: 393310
2013-10-31 20:32:26,757 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:32:26,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.jar dst=null perm=null
2013-10-31 20:32:26,788 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40018, bytes: 239915, op: HDFS_READ, cliID: DFSClient_974945305, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3700500589593143814_1086, duration: 1338690
2013-10-31 20:32:26,836 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642) Starting thread to transfer block blk_3700500589593143814_1086 to 127.0.0.1:33202
2013-10-31 20:32:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4723970173738345539_1077 file build/test/data/dfs/data/data1/current/blk_-4723970173738345539 for deletion
2013-10-31 20:32:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3925264537682707559_1079 file build/test/data/dfs/data/data1/current/blk_-3925264537682707559 for deletion
2013-10-31 20:32:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4723970173738345539_1077 at file build/test/data/dfs/data/data1/current/blk_-4723970173738345539
2013-10-31 20:32:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8484553367909035636_1078 file build/test/data/dfs/data/data2/current/blk_8484553367909035636 for deletion
2013-10-31 20:32:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3925264537682707559_1079 at file build/test/data/dfs/data/data1/current/blk_-3925264537682707559
2013-10-31 20:32:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8484553367909035636_1078 at file build/test/data/dfs/data/data2/current/blk_8484553367909035636
2013-10-31 20:32:26,838 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3700500589593143814_1086 src: /127.0.0.1:44311 dest: /127.0.0.1:33202
2013-10-31 20:32:26,838 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642):Transmitted block blk_3700500589593143814_1086 to /127.0.0.1:33202
2013-10-31 20:32:26,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3700500589593143814_1086 src: /127.0.0.1:44311 dest: /127.0.0.1:33202 of size 238055
2013-10-31 20:32:26,844 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3700500589593143814_1086 size 238055
2013-10-31 20:32:26,885 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0010_m_-1968298849
2013-10-31 20:32:26,885 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0010_m_-1968298849 spawned.
2013-10-31 20:32:26,888 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0010/attempt_20131031202710049_0010_m_000002_0/taskjvm.sh
2013-10-31 20:32:27,191 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0009
2013-10-31 20:32:27,191 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0009 being deleted.
2013-10-31 20:32:27,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8394885687740365629_1083 file build/test/data/dfs/data/data4/current/blk_-8394885687740365629 for deletion
2013-10-31 20:32:27,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4723970173738345539_1077 file build/test/data/dfs/data/data3/current/blk_-4723970173738345539 for deletion
2013-10-31 20:32:27,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3925264537682707559_1079 file build/test/data/dfs/data/data3/current/blk_-3925264537682707559 for deletion
2013-10-31 20:32:27,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1365030839145346734_1080 file build/test/data/dfs/data/data4/current/blk_-1365030839145346734 for deletion
2013-10-31 20:32:27,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8484553367909035636_1078 file build/test/data/dfs/data/data4/current/blk_8484553367909035636 for deletion
2013-10-31 20:32:27,349 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8394885687740365629_1083 at file build/test/data/dfs/data/data4/current/blk_-8394885687740365629
2013-10-31 20:32:27,349 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4723970173738345539_1077 at file build/test/data/dfs/data/data3/current/blk_-4723970173738345539
2013-10-31 20:32:27,350 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1365030839145346734_1080 at file build/test/data/dfs/data/data4/current/blk_-1365030839145346734
2013-10-31 20:32:27,350 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3925264537682707559_1079 at file build/test/data/dfs/data/data3/current/blk_-3925264537682707559
2013-10-31 20:32:27,350 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8484553367909035636_1078 at file build/test/data/dfs/data/data4/current/blk_8484553367909035636
2013-10-31 20:32:27,456 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0009
2013-10-31 20:32:27,456 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0009 being deleted.
2013-10-31 20:32:28,141 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0010_m_-1968298849 given task: attempt_20131031202710049_0010_m_000002_0
2013-10-31 20:32:28,442 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-8394885687740365629_1083
2013-10-31 20:32:28,442 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-8394885687740365629_1083
2013-10-31 20:32:28,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:30,278 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0009
2013-10-31 20:32:30,279 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0009_m_000002_0 not found in cache
2013-10-31 20:32:30,280 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0009 for user-log deletion with retainTimeStamp:1383337950280
2013-10-31 20:32:30,391 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0009_r_-781670435 since job job_20131031202710049_0009 is dead
2013-10-31 20:32:30,401 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30213 with signal TERM. Exit code 0
2013-10-31 20:32:30,583 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:30,583 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:30,583 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:30,584 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0009_r_-781670435 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:32:30,729 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8394885687740365629_1083 file build/test/data/dfs/data/data5/current/blk_-8394885687740365629 for deletion
2013-10-31 20:32:30,730 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8394885687740365629_1083 at file build/test/data/dfs/data/data5/current/blk_-8394885687740365629
2013-10-31 20:32:31,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8394885687740365629_1083 file build/test/data/dfs/data/data8/current/blk_-8394885687740365629 for deletion
2013-10-31 20:32:31,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8394885687740365629_1083 at file build/test/data/dfs/data/data8/current/blk_-8394885687740365629
2013-10-31 20:32:31,307 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0009_m_773281432 since job job_20131031202710049_0009 is dead
2013-10-31 20:32:31,316 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29968 with signal TERM. Exit code 0
2013-10-31 20:32:31,526 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:31,526 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:31,526 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:31,528 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0009_m_773281432 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:32:31,590 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_m_000002_0 0.0% setup
2013-10-31 20:32:31,592 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0010_m_000002_0 is done.
2013-10-31 20:32:31,593 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0010_m_000002_0 was -1
2013-10-31 20:32:31,593 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:31,625 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0009_m_-1802887264 since job job_20131031202710049_0009 is dead
2013-10-31 20:32:31,635 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30075 with signal TERM. Exit code 0
2013-10-31 20:32:31,705 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0009
2013-10-31 20:32:31,706 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0009 for user-log deletion with retainTimeStamp:1383337951706
2013-10-31 20:32:31,842 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:31,842 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:31,842 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:31,842 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0009_m_-1802887264 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:32:32,064 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0009_m_993114345 since job job_20131031202710049_0009 is dead
2013-10-31 20:32:32,074 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30144 with signal TERM. Exit code 0
2013-10-31 20:32:32,275 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:32:32,275 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:32:32,275 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:32:32,275 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0009_m_993114345 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:32:32,711 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0010_m_000002_0' has completed task_20131031202710049_0010_m_000002 successfully.
2013-10-31 20:32:32,717 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0010_m_000000_0' to tip task_20131031202710049_0010_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:32:32,718 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0010_m_000000
2013-10-31 20:32:32,720 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0010_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:32:32,720 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0010_m_000000_0 which needs 1 slots
2013-10-31 20:32:32,720 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0010_m_000000_0 which needs 1 slots
2013-10-31 20:32:32,758 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0010_m_1780486175
2013-10-31 20:32:32,758 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0010_m_1780486175 spawned.
2013-10-31 20:32:32,761 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0010/attempt_20131031202710049_0010_m_000000_0/taskjvm.sh
2013-10-31 20:32:33,683 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0010_m_1780486175 given task: attempt_20131031202710049_0010_m_000000_0
2013-10-31 20:32:34,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010/job.split dst=null perm=null
2013-10-31 20:32:34,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44319, bytes: 361, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0010_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-2587470771615567516_1087, duration: 277724
2013-10-31 20:32:34,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/part-00000 dst=null perm=null
2013-10-31 20:32:34,218 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44320, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0010_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-449800296977096095_1084, duration: 345538
2013-10-31 20:32:37,105 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF/part-00000:0+708
2013-10-31 20:32:37,107 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0010_m_000000_0 is done.
2013-10-31 20:32:37,107 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0010_m_000000_0 was 764
2013-10-31 20:32:37,108 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:37,720 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0010_m_000002_0
2013-10-31 20:32:37,721 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0010_m_000002_0
2013-10-31 20:32:37,721 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0010_m_000002_0 not found in cache
2013-10-31 20:32:38,726 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0010_m_000000_0' has completed task_20131031202710049_0010_m_000000 successfully.
2013-10-31 20:32:38,741 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0010_r_000000_0' to tip task_20131031202710049_0010_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:32:38,743 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0010_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:32:38,743 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0010_r_000000_0 which needs 1 slots
2013-10-31 20:32:38,743 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0010_r_000000_0 which needs 1 slots
2013-10-31 20:32:38,779 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0010_r_167773886
2013-10-31 20:32:38,779 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0010_r_167773886 spawned.
2013-10-31 20:32:38,781 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0010/attempt_20131031202710049_0010_r_000000_0/taskjvm.sh
2013-10-31 20:32:39,647 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0010_r_167773886 given task: attempt_20131031202710049_0010_r_000000_0
2013-10-31 20:32:45,288 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53581, bytes: 764, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0010_m_000000_0, duration: 7988847
2013-10-31 20:32:46,123 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:32:46,168 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:32:46,249 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:32:46,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:46,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:46,490 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0/part-00000. blk_-7714294466747441720_1093
2013-10-31 20:32:46,532 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7714294466747441720_1093 src: /127.0.0.1:35938 dest: /127.0.0.1:49827
2013-10-31 20:32:46,534 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7714294466747441720_1093 src: /127.0.0.1:34543 dest: /127.0.0.1:37249
2013-10-31 20:32:46,534 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7714294466747441720_1093 src: /127.0.0.1:44326 dest: /127.0.0.1:33202
2013-10-31 20:32:46,538 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44326, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0010_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7714294466747441720_1093, duration: 2336797
2013-10-31 20:32:46,538 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7714294466747441720_1093 terminating
2013-10-31 20:32:46,539 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34543, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0010_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7714294466747441720_1093, duration: 3357557
2013-10-31 20:32:46,539 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7714294466747441720_1093 terminating
2013-10-31 20:32:46,539 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35938, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0010_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7714294466747441720_1093, duration: 4037396
2013-10-31 20:32:46,540 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7714294466747441720_1093 terminating
2013-10-31 20:32:46,542 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7714294466747441720_1093 size 708
2013-10-31 20:32:46,543 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7714294466747441720_1093 size 708
2013-10-31 20:32:46,543 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0010_r_000000_0
2013-10-31 20:32:46,543 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0010_r_000000_0
2013-10-31 20:32:46,543 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7714294466747441720_1093 size 708
2013-10-31 20:32:46,578 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0010_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:32:46,578 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:32:47,753 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0010_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:32:47,754 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0010_r_000000_0
2013-10-31 20:32:48,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0 dst=null perm=null
2013-10-31 20:32:48,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:48,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:48,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary/_attempt_20131031202710049_0010_r_000000_0 dst=null perm=null
2013-10-31 20:32:49,174 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_r_000000_0 1.0% reduce > reduce
2013-10-31 20:32:49,176 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_r_000000_0 1.0% reduce > reduce
2013-10-31 20:32:49,176 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0010_r_000000_0 is done.
2013-10-31 20:32:49,176 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0010_r_000000_0 was -1
2013-10-31 20:32:49,177 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:50,758 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0010_r_000000_0' has completed task_20131031202710049_0010_r_000000 successfully.
2013-10-31 20:32:50,762 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0010_m_000001_0' to tip task_20131031202710049_0010_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:32:50,764 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0010_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:32:50,764 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0010_m_000001_0 which needs 1 slots
2013-10-31 20:32:50,764 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0010_m_000001_0 which needs 1 slots
2013-10-31 20:32:50,800 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0010/attempt_20131031202710049_0010_m_000001_0. Attempting to reuse: jvm_20131031202710049_0010_m_-1968298849
2013-10-31 20:32:51,664 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0010_m_-1968298849 given task: attempt_20131031202710049_0010_m_000001_0
2013-10-31 20:32:51,780 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_m_000001_0 0.0%
2013-10-31 20:32:51,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary dst=null perm=null
2013-10-31 20:32:51,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:51,809 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_SUCCESS from client DFSClient_attempt_20131031202710049_0010_m_000001_0
2013-10-31 20:32:51,809 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0010_m_000001_0
2013-10-31 20:32:51,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3700500589593143814 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:51,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3700500589593143814 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3700500589593143814 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3700500589593143814 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2587470771615567516 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2587470771615567516 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2587470771615567516 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2587470771615567516 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5089405292572100631 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5089405292572100631 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5089405292572100631 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6202780330174234313 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6202780330174234313 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:51,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6202780330174234313 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:51,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0010 dst=null perm=null
2013-10-31 20:32:52,446 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_5089405292572100631_1088 blk_6202780330174234313_1089 blk_3700500589593143814_1086 blk_-2587470771615567516_1087
2013-10-31 20:32:52,446 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_5089405292572100631_1088 blk_3700500589593143814_1086 blk_-2587470771615567516_1087
2013-10-31 20:32:54,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2587470771615567516_1087 file build/test/data/dfs/data/data4/current/blk_-2587470771615567516 for deletion
2013-10-31 20:32:54,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3700500589593143814_1086 file build/test/data/dfs/data/data4/current/blk_3700500589593143814 for deletion
2013-10-31 20:32:54,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2587470771615567516_1087 at file build/test/data/dfs/data/data4/current/blk_-2587470771615567516
2013-10-31 20:32:54,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5089405292572100631_1088 file build/test/data/dfs/data/data3/current/blk_5089405292572100631 for deletion
2013-10-31 20:32:54,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3700500589593143814_1086 at file build/test/data/dfs/data/data4/current/blk_3700500589593143814
2013-10-31 20:32:54,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5089405292572100631_1088 at file build/test/data/dfs/data/data3/current/blk_5089405292572100631
2013-10-31 20:32:54,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2587470771615567516_1087 file build/test/data/dfs/data/data5/current/blk_-2587470771615567516 for deletion
2013-10-31 20:32:54,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3700500589593143814_1086 file build/test/data/dfs/data/data6/current/blk_3700500589593143814 for deletion
2013-10-31 20:32:54,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2587470771615567516_1087 at file build/test/data/dfs/data/data5/current/blk_-2587470771615567516
2013-10-31 20:32:54,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5089405292572100631_1088 file build/test/data/dfs/data/data6/current/blk_5089405292572100631 for deletion
2013-10-31 20:32:54,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3700500589593143814_1086 at file build/test/data/dfs/data/data6/current/blk_3700500589593143814
2013-10-31 20:32:54,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6202780330174234313_1089 file build/test/data/dfs/data/data5/current/blk_6202780330174234313 for deletion
2013-10-31 20:32:54,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5089405292572100631_1088 at file build/test/data/dfs/data/data6/current/blk_5089405292572100631
2013-10-31 20:32:54,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6202780330174234313_1089 at file build/test/data/dfs/data/data5/current/blk_6202780330174234313
2013-10-31 20:32:54,750 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0010_m_000001_0 0.0% cleanup
2013-10-31 20:32:54,752 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0010_m_000001_0 is done.
2013-10-31 20:32:54,752 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0010_m_000001_0 was -1
2013-10-31 20:32:54,752 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:32:55,240 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_1923996118185355645_1011
2013-10-31 20:32:55,447 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_6202780330174234313_1089 blk_3700500589593143814_1086 blk_-2587470771615567516_1087
2013-10-31 20:32:55,447 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_5089405292572100631_1088 blk_6202780330174234313_1089 blk_3700500589593143814_1086 blk_-2587470771615567516_1087
2013-10-31 20:32:55,765 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0010_r_000000_0
2013-10-31 20:32:55,765 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0010_r_000000_0
2013-10-31 20:32:56,772 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0010_m_000001_0' has completed task_20131031202710049_0010_m_000001 successfully.
2013-10-31 20:32:56,773 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0010 has completed successfully.
2013-10-31 20:32:56,773 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0010,submitTime=1383251545848,launchTime=1383251546137,firstMapTaskLaunchTime=1383251552717,firstReduceTaskLaunchTime=1383251558740,firstJobSetupTaskLaunchTime=1383251546697,firstJobCleanupTaskLaunchTime=1383251570762,finishTime=1383251576773,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[72633E7DC6A24FA88B7D2EADF9ABB1AE/3E2375243CE249BE9364DEC84514BECA] lower*upper/(2/2) ...ue/false/true/false/false
2013-10-31 20:32:56,779 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_1383251545848_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2F3E2375243CE249BE. blk_5169074658793665241_1094
2013-10-31 20:32:56,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5169074658793665241_1094 src: /127.0.0.1:40039 dest: /127.0.0.1:46399
2013-10-31 20:32:56,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5169074658793665241_1094 src: /127.0.0.1:34550 dest: /127.0.0.1:37249
2013-10-31 20:32:56,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5169074658793665241_1094 src: /127.0.0.1:44333 dest: /127.0.0.1:33202
2013-10-31 20:32:56,798 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44333, dest: /127.0.0.1:33202, bytes: 16920, op: HDFS_WRITE, cliID: DFSClient_1179902549, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5169074658793665241_1094, duration: 6990123
2013-10-31 20:32:56,798 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5169074658793665241_1094 terminating
2013-10-31 20:32:56,799 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34550, dest: /127.0.0.1:37249, bytes: 16920, op: HDFS_WRITE, cliID: DFSClient_1179902549, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_5169074658793665241_1094, duration: 6304629
2013-10-31 20:32:56,800 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5169074658793665241_1094 size 16920
2013-10-31 20:32:56,800 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5169074658793665241_1094 terminating
2013-10-31 20:32:56,801 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40039, dest: /127.0.0.1:46399, bytes: 16920, op: HDFS_WRITE, cliID: DFSClient_1179902549, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5169074658793665241_1094, duration: 8376686
2013-10-31 20:32:56,801 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_5169074658793665241_1094 size 16920
2013-10-31 20:32:56,802 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5169074658793665241_1094 terminating
2013-10-31 20:32:56,804 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5169074658793665241_1094 size 16920
2013-10-31 20:32:56,805 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_1383251545848_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2F3E2375243CE249BE from client DFSClient_1179902549
2013-10-31 20:32:56,805 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_logs/history/job_20131031202710049_0010_1383251545848_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2F3E2375243CE249BE is closed by DFSClient_1179902549
2013-10-31 20:32:56,815 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0010_1383251545848_hadoop_%5B72633E7DC6A24FA88B7D2EADF9ABB1AE%2F3E2375243CE249BE to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:32:56,816 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0010_m_000000_0'
2013-10-31 20:32:56,816 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0010_m_000001_0'
2013-10-31 20:32:56,818 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0010_m_000002_0'
2013-10-31 20:32:56,818 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828930916166671 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:56,818 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0010_r_000000_0'
2013-10-31 20:32:56,818 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828930916166671 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:56,819 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828930916166671 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:56,824 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0010_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:32:56,825 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1791529231798605238 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:56,825 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1791529231798605238 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:56,825 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1791529231798605238 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:32:56,826 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7428201871889901788 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:56,826 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7428201871889901788 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:56,826 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7428201871889901788 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:56,826 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-449800296977096095 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:32:56,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0010 dst=null perm=null
2013-10-31 20:32:56,826 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-449800296977096095 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:32:56,827 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-449800296977096095 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:32:56,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/123856710_lower_upper_3665456B16F44FC0B6963A788EA0BDDF dst=null perm=null
2013-10-31 20:32:56,834 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/_temporary
2013-10-31 20:32:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2587470771615567516_1087 file build/test/data/dfs/data/data2/current/blk_-2587470771615567516 for deletion
2013-10-31 20:32:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3700500589593143814_1086 file build/test/data/dfs/data/data1/current/blk_3700500589593143814 for deletion
2013-10-31 20:32:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2587470771615567516_1087 at file build/test/data/dfs/data/data2/current/blk_-2587470771615567516
2013-10-31 20:32:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5089405292572100631_1088 file build/test/data/dfs/data/data1/current/blk_5089405292572100631 for deletion
2013-10-31 20:32:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3700500589593143814_1086 at file build/test/data/dfs/data/data1/current/blk_3700500589593143814
2013-10-31 20:32:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6202780330174234313_1089 file build/test/data/dfs/data/data2/current/blk_6202780330174234313 for deletion
2013-10-31 20:32:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5089405292572100631_1088 at file build/test/data/dfs/data/data1/current/blk_5089405292572100631
2013-10-31 20:32:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6202780330174234313_1089 at file build/test/data/dfs/data/data2/current/blk_6202780330174234313
2013-10-31 20:32:56,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false dst=null perm=null
2013-10-31 20:32:56,855 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:32:56,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:32:56,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:32:56,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35949, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7714294466747441720_1093, duration: 412314
2013-10-31 20:32:56,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false dst=null perm=null
2013-10-31 20:32:56,870 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:32:56,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:32:56,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:32:56,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35950, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7714294466747441720_1093, duration: 205571
2013-10-31 20:32:56,875 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false
2013-10-31 20:32:56,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false dst=null perm=null
2013-10-31 20:32:56,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:32:56,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34555, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7714294466747441720_1093, duration: 147815
2013-10-31 20:32:56,890 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:32:56,890 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:32:56,915 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:32:56,916 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:32:56,916 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:32:56,916 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true"]
2013-10-31 20:32:56,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:32:56,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:32:56,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:32:56,918 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:32:56,923 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:32:56,923 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:32:56,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:32:56,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:32:56,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:56,948 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar. blk_-1844005119933000365_1095
2013-10-31 20:32:56,949 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1844005119933000365_1095 src: /127.0.0.1:44338 dest: /127.0.0.1:33202
2013-10-31 20:32:56,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1844005119933000365_1095 src: /127.0.0.1:35953 dest: /127.0.0.1:49827
2013-10-31 20:32:56,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1844005119933000365_1095 src: /127.0.0.1:34558 dest: /127.0.0.1:37249
2013-10-31 20:32:56,961 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34558, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1844005119933000365_1095, duration: 4725703
2013-10-31 20:32:56,961 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1844005119933000365_1095 terminating
2013-10-31 20:32:56,962 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35953, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1844005119933000365_1095, duration: 6720749
2013-10-31 20:32:56,963 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1844005119933000365_1095 terminating
2013-10-31 20:32:56,964 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44338, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1844005119933000365_1095, duration: 7934674
2013-10-31 20:32:56,964 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1844005119933000365_1095 terminating
2013-10-31 20:32:56,965 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1844005119933000365_1095 size 238055
2013-10-31 20:32:56,966 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar from client DFSClient_848976415
2013-10-31 20:32:56,966 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar is closed by DFSClient_848976415
2013-10-31 20:32:56,967 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1844005119933000365_1095 size 238055
2013-10-31 20:32:56,967 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1844005119933000365_1095 size 238055
2013-10-31 20:32:56,972 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar. New replication is 10
2013-10-31 20:32:56,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar dst=null perm=null
2013-10-31 20:32:56,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:56,983 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:32:56,989 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:32:56,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:32:56,993 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:32:56,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:32:57,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,006 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split. New replication is 10
2013-10-31 20:32:57,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split dst=null perm=null
2013-10-31 20:32:57,014 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split. blk_6454245876950858246_1096
2013-10-31 20:32:57,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6454245876950858246_1096 src: /127.0.0.1:44341 dest: /127.0.0.1:33202
2013-10-31 20:32:57,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6454245876950858246_1096 src: /127.0.0.1:40050 dest: /127.0.0.1:46399
2013-10-31 20:32:57,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6454245876950858246_1096 src: /127.0.0.1:34561 dest: /127.0.0.1:37249
2013-10-31 20:32:57,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6454245876950858246_1096 src: /127.0.0.1:35958 dest: /127.0.0.1:49827
2013-10-31 20:32:57,025 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35958, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6454245876950858246_1096, duration: 1063585
2013-10-31 20:32:57,025 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6454245876950858246_1096 terminating
2013-10-31 20:32:57,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6454245876950858246_1096 size 697
2013-10-31 20:32:57,027 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34561, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6454245876950858246_1096, duration: 3158996
2013-10-31 20:32:57,027 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6454245876950858246_1096 terminating
2013-10-31 20:32:57,029 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40050, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6454245876950858246_1096, duration: 4750741
2013-10-31 20:32:57,029 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6454245876950858246_1096 terminating
2013-10-31 20:32:57,030 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44341, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6454245876950858246_1096, duration: 6254106
2013-10-31 20:32:57,031 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6454245876950858246_1096 terminating
2013-10-31 20:32:57,034 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6454245876950858246_1096 size 697
2013-10-31 20:32:57,035 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split from client DFSClient_848976415
2013-10-31 20:32:57,035 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split is closed by DFSClient_848976415
2013-10-31 20:32:57,035 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6454245876950858246_1096 size 697
2013-10-31 20:32:57,036 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6454245876950858246_1096 size 697
2013-10-31 20:32:57,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,052 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.splitmetainfo. blk_7845851509003246631_1097
2013-10-31 20:32:57,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7845851509003246631_1097 src: /127.0.0.1:44345 dest: /127.0.0.1:33202
2013-10-31 20:32:57,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7845851509003246631_1097 src: /127.0.0.1:40054 dest: /127.0.0.1:46399
2013-10-31 20:32:57,059 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7845851509003246631_1097 src: /127.0.0.1:35961 dest: /127.0.0.1:49827
2013-10-31 20:32:57,064 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35961, dest: /127.0.0.1:49827, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7845851509003246631_1097, duration: 682382
2013-10-31 20:32:57,064 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7845851509003246631_1097 terminating
2013-10-31 20:32:57,065 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40054, dest: /127.0.0.1:46399, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7845851509003246631_1097, duration: 3496970
2013-10-31 20:32:57,066 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7845851509003246631_1097 terminating
2013-10-31 20:32:57,067 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44345, dest: /127.0.0.1:33202, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7845851509003246631_1097, duration: 5245375
2013-10-31 20:32:57,068 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7845851509003246631_1097 terminating
2013-10-31 20:32:57,068 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7845851509003246631_1097 size 78
2013-10-31 20:32:57,070 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7845851509003246631_1097 size 78
2013-10-31 20:32:57,071 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:32:57,071 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:32:57,072 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7845851509003246631_1097 size 78
2013-10-31 20:32:57,218 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0010
2013-10-31 20:32:57,218 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0010 being deleted.
2013-10-31 20:32:57,487 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0010
2013-10-31 20:32:57,487 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0010 being deleted.
2013-10-31 20:32:57,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,512 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml. blk_2002484192113999050_1098
2013-10-31 20:32:57,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2002484192113999050_1098 src: /127.0.0.1:34566 dest: /127.0.0.1:37249
2013-10-31 20:32:57,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2002484192113999050_1098 src: /127.0.0.1:35963 dest: /127.0.0.1:49827
2013-10-31 20:32:57,517 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2002484192113999050_1098 src: /127.0.0.1:44350 dest: /127.0.0.1:33202
2013-10-31 20:32:57,521 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44350, dest: /127.0.0.1:33202, bytes: 29375, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2002484192113999050_1098, duration: 960579
2013-10-31 20:32:57,521 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2002484192113999050_1098 terminating
2013-10-31 20:32:57,522 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35963, dest: /127.0.0.1:49827, bytes: 29375, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2002484192113999050_1098, duration: 2523826
2013-10-31 20:32:57,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2002484192113999050_1098 terminating
2013-10-31 20:32:57,524 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34566, dest: /127.0.0.1:37249, bytes: 29375, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2002484192113999050_1098, duration: 4065557
2013-10-31 20:32:57,524 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2002484192113999050_1098 terminating
2013-10-31 20:32:57,524 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2002484192113999050_1098 size 29375
2013-10-31 20:32:57,527 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2002484192113999050_1098 size 29375
2013-10-31 20:32:57,528 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml from client DFSClient_848976415
2013-10-31 20:32:57,528 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml is closed by DFSClient_848976415
2013-10-31 20:32:57,529 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2002484192113999050_1098 size 29375
2013-10-31 20:32:57,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml dst=null perm=null
2013-10-31 20:32:57,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44352, bytes: 29607, op: HDFS_READ, cliID: DFSClient_-643886743, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2002484192113999050_1098, duration: 401872
2013-10-31 20:32:57,565 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0011: nMaps=2 nReduces=1 max=-1
2013-10-31 20:32:57,565 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0011 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:32:57,565 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0011
2013-10-31 20:32:57,566 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0011 RESULT=SUCCESS
2013-10-31 20:32:57,566 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0011
2013-10-31 20:32:57,568 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0011
2013-10-31 20:32:57,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_1383251577534_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F1B96B904EEE64033 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,609 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_conf.xml. blk_-7403607125588767935_1100
2013-10-31 20:32:57,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7403607125588767935_1100 src: /127.0.0.1:44353 dest: /127.0.0.1:33202
2013-10-31 20:32:57,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7403607125588767935_1100 src: /127.0.0.1:40062 dest: /127.0.0.1:46399
2013-10-31 20:32:57,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7403607125588767935_1100 src: /127.0.0.1:34573 dest: /127.0.0.1:37249
2013-10-31 20:32:57,622 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34573, dest: /127.0.0.1:37249, bytes: 29440, op: HDFS_WRITE, cliID: DFSClient_-643886743, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7403607125588767935_1100, duration: 4569779
2013-10-31 20:32:57,622 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7403607125588767935_1100 terminating
2013-10-31 20:32:57,622 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7403607125588767935_1100 size 29440
2013-10-31 20:32:57,624 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40062, dest: /127.0.0.1:46399, bytes: 29440, op: HDFS_WRITE, cliID: DFSClient_-643886743, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7403607125588767935_1100, duration: 7135056
2013-10-31 20:32:57,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7403607125588767935_1100 terminating
2013-10-31 20:32:57,625 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44353, dest: /127.0.0.1:33202, bytes: 29440, op: HDFS_WRITE, cliID: DFSClient_-643886743, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7403607125588767935_1100, duration: 8006065
2013-10-31 20:32:57,625 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7403607125588767935_1100 size 29440
2013-10-31 20:32:57,626 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7403607125588767935_1100 terminating
2013-10-31 20:32:57,627 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_conf.xml from client DFSClient_-643886743
2013-10-31 20:32:57,628 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_conf.xml is closed by DFSClient_-643886743
2013-10-31 20:32:57,628 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7403607125588767935_1100 size 29440
2013-10-31 20:32:57,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:32:57,639 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken. blk_2696325249328552901_1101
2013-10-31 20:32:57,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2696325249328552901_1101 src: /127.0.0.1:35970 dest: /127.0.0.1:49827
2013-10-31 20:32:57,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2696325249328552901_1101 src: /127.0.0.1:40065 dest: /127.0.0.1:46399
2013-10-31 20:32:57,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2696325249328552901_1101 src: /127.0.0.1:34576 dest: /127.0.0.1:37249
2013-10-31 20:32:57,648 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34576, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2696325249328552901_1101, duration: 1866275
2013-10-31 20:32:57,648 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2696325249328552901_1101 terminating
2013-10-31 20:32:57,649 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40065, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2696325249328552901_1101, duration: 2685359
2013-10-31 20:32:57,650 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2696325249328552901_1101 terminating
2013-10-31 20:32:57,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35970, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2696325249328552901_1101, duration: 3676196
2013-10-31 20:32:57,650 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2696325249328552901_1101 terminating
2013-10-31 20:32:57,650 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2696325249328552901_1101 size 116
2013-10-31 20:32:57,653 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken from client DFSClient_848976415
2013-10-31 20:32:57,654 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken is closed by DFSClient_848976415
2013-10-31 20:32:57,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2696325249328552901_1101 size 116
2013-10-31 20:32:57,655 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2696325249328552901_1101 size 116
2013-10-31 20:32:57,658 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken
2013-10-31 20:32:57,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.splitmetainfo dst=null perm=null
2013-10-31 20:32:57,662 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40067, bytes: 82, op: HDFS_READ, cliID: DFSClient_-643886743, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7845851509003246631_1097, duration: 276465
2013-10-31 20:32:57,663 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0011 = 38. Number of splits = 2
2013-10-31 20:32:57,663 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:57,664 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:57,664 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:57,664 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:57,664 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:57,665 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:32:57,665 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0011 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:32:57,665 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0011 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:32:58,120 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2587470771615567516_1087 file build/test/data/dfs/data/data8/current/blk_-2587470771615567516 for deletion
2013-10-31 20:32:58,120 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3700500589593143814_1086 file build/test/data/dfs/data/data7/current/blk_3700500589593143814 for deletion
2013-10-31 20:32:58,120 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2587470771615567516_1087 at file build/test/data/dfs/data/data8/current/blk_-2587470771615567516
2013-10-31 20:32:58,120 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6202780330174234313_1089 file build/test/data/dfs/data/data7/current/blk_6202780330174234313 for deletion
2013-10-31 20:32:58,121 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3700500589593143814_1086 at file build/test/data/dfs/data/data7/current/blk_3700500589593143814
2013-10-31 20:32:58,121 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6202780330174234313_1089 at file build/test/data/dfs/data/data7/current/blk_6202780330174234313
2013-10-31 20:32:58,314 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0011_m_000003_0' to tip task_20131031202710049_0011_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:32:58,319 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0011_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:32:58,320 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0011_m_000003_0 which needs 1 slots
2013-10-31 20:32:58,320 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0010
2013-10-31 20:32:58,320 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0011_m_000003_0 which needs 1 slots
2013-10-31 20:32:58,320 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0010 being deleted.
2013-10-31 20:32:58,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken dst=null perm=null
2013-10-31 20:32:58,330 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40068, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2696325249328552901_1101, duration: 270799
2013-10-31 20:32:58,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml dst=null perm=null
2013-10-31 20:32:58,341 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34580, bytes: 29607, op: HDFS_READ, cliID: DFSClient_1843653402, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2002484192113999050_1098, duration: 381317
2013-10-31 20:32:58,367 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:32:58,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar dst=null perm=null
2013-10-31 20:32:58,403 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35977, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1843653402, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1844005119933000365_1095, duration: 1192458
2013-10-31 20:32:58,448 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:49827 to replicate blk_-1844005119933000365_1095 to datanode(s) 127.0.0.1:46399
2013-10-31 20:32:58,448 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-8554828930916166671_1092 blk_-449800296977096095_1084 blk_-7428201871889901788_1082
2013-10-31 20:32:58,448 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-449800296977096095_1084 blk_-7428201871889901788_1082 blk_-1791529231798605238_1085
2013-10-31 20:32:58,503 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0011_m_847623924
2013-10-31 20:32:58,504 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0011_m_847623924 spawned.
2013-10-31 20:32:58,506 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0011/attempt_20131031202710049_0011_m_000003_0/taskjvm.sh
2013-10-31 20:32:59,709 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0011_m_847623924 given task: attempt_20131031202710049_0011_m_000003_0
2013-10-31 20:33:00,087 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_6920487667347938972_1001
2013-10-31 20:33:00,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:00,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828930916166671_1092 file build/test/data/dfs/data/data3/current/blk_-8554828930916166671 for deletion
2013-10-31 20:33:00,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7428201871889901788_1082 file build/test/data/dfs/data/data3/current/blk_-7428201871889901788 for deletion
2013-10-31 20:33:00,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828930916166671_1092 at file build/test/data/dfs/data/data3/current/blk_-8554828930916166671
2013-10-31 20:33:00,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-449800296977096095_1084 file build/test/data/dfs/data/data3/current/blk_-449800296977096095 for deletion
2013-10-31 20:33:00,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7428201871889901788_1082 at file build/test/data/dfs/data/data3/current/blk_-7428201871889901788
2013-10-31 20:33:00,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-449800296977096095_1084 at file build/test/data/dfs/data/data3/current/blk_-449800296977096095
2013-10-31 20:33:01,121 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207) Starting thread to transfer block blk_-1844005119933000365_1095 to 127.0.0.1:46399
2013-10-31 20:33:01,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7428201871889901788_1082 file build/test/data/dfs/data/data7/current/blk_-7428201871889901788 for deletion
2013-10-31 20:33:01,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1791529231798605238_1085 file build/test/data/dfs/data/data8/current/blk_-1791529231798605238 for deletion
2013-10-31 20:33:01,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7428201871889901788_1082 at file build/test/data/dfs/data/data7/current/blk_-7428201871889901788
2013-10-31 20:33:01,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-449800296977096095_1084 file build/test/data/dfs/data/data7/current/blk_-449800296977096095 for deletion
2013-10-31 20:33:01,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1791529231798605238_1085 at file build/test/data/dfs/data/data8/current/blk_-1791529231798605238
2013-10-31 20:33:01,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-449800296977096095_1084 at file build/test/data/dfs/data/data7/current/blk_-449800296977096095
2013-10-31 20:33:01,124 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207):Transmitted block blk_-1844005119933000365_1095 to /127.0.0.1:46399
2013-10-31 20:33:01,124 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1844005119933000365_1095 src: /127.0.0.1:40074 dest: /127.0.0.1:46399
2013-10-31 20:33:01,128 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1844005119933000365_1095 src: /127.0.0.1:40074 dest: /127.0.0.1:46399 of size 238055
2013-10-31 20:33:01,131 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1844005119933000365_1095 size 238055
2013-10-31 20:33:01,449 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-8554828930916166671_1092 blk_-1791529231798605238_1085
2013-10-31 20:33:01,449 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-8554828930916166671_1092 blk_-449800296977096095_1084 blk_-7428201871889901788_1082 blk_-1791529231798605238_1085
2013-10-31 20:33:01,819 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0010
2013-10-31 20:33:01,819 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0010_m_000001_0 not found in cache
2013-10-31 20:33:01,820 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0010 for user-log deletion with retainTimeStamp:1383337981820
2013-10-31 20:33:02,790 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0010_m_-1968298849 since job job_20131031202710049_0010 is dead
2013-10-31 20:33:02,801 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30405 with signal TERM. Exit code 0
2013-10-31 20:33:02,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828930916166671_1092 file build/test/data/dfs/data/data2/current/blk_-8554828930916166671 for deletion
2013-10-31 20:33:02,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7428201871889901788_1082 file build/test/data/dfs/data/data2/current/blk_-7428201871889901788 for deletion
2013-10-31 20:33:02,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828930916166671_1092 at file build/test/data/dfs/data/data2/current/blk_-8554828930916166671
2013-10-31 20:33:02,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1791529231798605238_1085 file build/test/data/dfs/data/data2/current/blk_-1791529231798605238 for deletion
2013-10-31 20:33:02,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7428201871889901788_1082 at file build/test/data/dfs/data/data2/current/blk_-7428201871889901788
2013-10-31 20:33:02,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-449800296977096095_1084 file build/test/data/dfs/data/data1/current/blk_-449800296977096095 for deletion
2013-10-31 20:33:02,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1791529231798605238_1085 at file build/test/data/dfs/data/data2/current/blk_-1791529231798605238
2013-10-31 20:33:02,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-449800296977096095_1084 at file build/test/data/dfs/data/data1/current/blk_-449800296977096095
2013-10-31 20:33:03,005 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:03,005 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:03,005 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:03,006 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0010_m_-1968298849 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:33:03,163 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_m_000003_0 0.0% setup
2013-10-31 20:33:03,166 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0011_m_000003_0 is done.
2013-10-31 20:33:03,166 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0011_m_000003_0 was -1
2013-10-31 20:33:03,167 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:03,194 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0010_m_1780486175 since job job_20131031202710049_0010 is dead
2013-10-31 20:33:03,201 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30525 with signal TERM. Exit code 0
2013-10-31 20:33:03,207 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0010_r_167773886 since job job_20131031202710049_0010 is dead
2013-10-31 20:33:03,216 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30607 with signal TERM. Exit code 0
2013-10-31 20:33:03,368 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:03,369 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:03,369 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:03,369 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0010_r_167773886 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:33:03,403 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:03,403 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:03,403 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:03,403 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0010_m_1780486175 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:33:03,741 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828930916166671_1092 file build/test/data/dfs/data/data5/current/blk_-8554828930916166671 for deletion
2013-10-31 20:33:03,741 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1791529231798605238_1085 file build/test/data/dfs/data/data5/current/blk_-1791529231798605238 for deletion
2013-10-31 20:33:03,741 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828930916166671_1092 at file build/test/data/dfs/data/data5/current/blk_-8554828930916166671
2013-10-31 20:33:03,742 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1791529231798605238_1085 at file build/test/data/dfs/data/data5/current/blk_-1791529231798605238
2013-10-31 20:33:04,325 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0011_m_000003_0' has completed task_20131031202710049_0011_m_000003 successfully.
2013-10-31 20:33:04,459 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0011_m_000000_0' to tip task_20131031202710049_0011_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:33:04,461 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0011_m_000000
2013-10-31 20:33:04,462 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0011_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:33:04,463 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0011_m_000000_0 which needs 1 slots
2013-10-31 20:33:04,463 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0011_m_000000_0 which needs 1 slots
2013-10-31 20:33:04,520 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0011_m_-1723445986
2013-10-31 20:33:04,521 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0011_m_-1723445986 spawned.
2013-10-31 20:33:04,524 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0011/attempt_20131031202710049_0011_m_000000_0/taskjvm.sh
2013-10-31 20:33:05,343 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0011_m_-1723445986 given task: attempt_20131031202710049_0011_m_000000_0
2013-10-31 20:33:05,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split dst=null perm=null
2013-10-31 20:33:05,827 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0011_m_000001_0' to tip task_20131031202710049_0011_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:33:05,827 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0011_m_000001
2013-10-31 20:33:05,828 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0011_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:33:05,828 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0011_m_000001_0 which needs 1 slots
2013-10-31 20:33:05,828 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0011_m_000001_0 which needs 1 slots
2013-10-31 20:33:05,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011/jobToken dst=null perm=null
2013-10-31 20:33:05,832 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34587, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0011_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6454245876950858246_1096, duration: 181958
2013-10-31 20:33:05,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34588, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2696325249328552901_1101, duration: 139236
2013-10-31 20:33:05,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.xml dst=null perm=null
2013-10-31 20:33:05,843 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34590, bytes: 29607, op: HDFS_READ, cliID: DFSClient_-339664141, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2002484192113999050_1098, duration: 390622
2013-10-31 20:33:05,863 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:33:05,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:33:05,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.jar dst=null perm=null
2013-10-31 20:33:05,878 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:35987, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-339664141, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1844005119933000365_1095, duration: 628792
2013-10-31 20:33:05,930 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0011_m_864492490
2013-10-31 20:33:05,930 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0011_m_864492490 spawned.
2013-10-31 20:33:05,932 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0011/attempt_20131031202710049_0011_m_000001_0/taskjvm.sh
2013-10-31 20:33:06,421 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44374, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0011_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4376294229090259720_1013, duration: 129106
2013-10-31 20:33:07,107 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0011_m_864492490 given task: attempt_20131031202710049_0011_m_000001_0
2013-10-31 20:33:07,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011/job.split dst=null perm=null
2013-10-31 20:33:07,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44377, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0011_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6454245876950858246_1096, duration: 156283
2013-10-31 20:33:07,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:33:07,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0011_m_000001_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 107221
2013-10-31 20:33:08,051 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:33:08,066 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:33:08,076 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:33:08,082 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:33:08,087 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:33:08,093 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:33:08,098 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:33:08,098 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:33:08,763 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:33:08,766 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0011_m_000000_0 is done.
2013-10-31 20:33:08,766 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0011_m_000000_0 was 506
2013-10-31 20:33:08,767 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:09,463 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0011_m_000003_0
2013-10-31 20:33:09,463 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0011_m_000003_0
2013-10-31 20:33:09,464 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0011_m_000003_0 not found in cache
2013-10-31 20:33:10,469 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0011_m_000000_0' has completed task_20131031202710049_0011_m_000000 successfully.
2013-10-31 20:33:10,471 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0011_r_000000_0' to tip task_20131031202710049_0011_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:33:10,474 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0011_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:33:10,474 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0011_r_000000_0 which needs 1 slots
2013-10-31 20:33:10,474 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0011_r_000000_0 which needs 1 slots
2013-10-31 20:33:10,504 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0011_r_3239044
2013-10-31 20:33:10,505 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0011_r_3239044 spawned.
2013-10-31 20:33:10,506 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0011/attempt_20131031202710049_0011_r_000000_0/taskjvm.sh
2013-10-31 20:33:10,522 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:33:10,525 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0011_m_000001_0 is done.
2013-10-31 20:33:10,525 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0011_m_000001_0 was 506
2013-10-31 20:33:10,525 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:11,485 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0011_r_3239044 given task: attempt_20131031202710049_0011_r_000000_0
2013-10-31 20:33:11,832 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0011_m_000001_0' has completed task_20131031202710049_0011_m_000001 successfully.
2013-10-31 20:33:14,808 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-9037159349091662048_1008
2013-10-31 20:33:17,091 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-2633881617539490211_1049
2013-10-31 20:33:17,192 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53265, bytes: 506, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0011_m_000000_0, duration: 9320776
2013-10-31 20:33:17,213 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53640, bytes: 506, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0011_m_000001_0, duration: 11698463
2013-10-31 20:33:17,986 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:33:18,043 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:33:18,108 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:33:18,310 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 540 Total time for transactions(ms): 13Number of transactions batched in Syncs: 18 Number of syncs: 367 SyncTimes(ms): 7646 1850
2013-10-31 20:33:18,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:18,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:18,369 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0/part-00000. blk_-2125533017326545911_1102
2013-10-31 20:33:18,407 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2125533017326545911_1102 src: /127.0.0.1:34601 dest: /127.0.0.1:37249
2013-10-31 20:33:18,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2125533017326545911_1102 src: /127.0.0.1:40092 dest: /127.0.0.1:46399
2013-10-31 20:33:18,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2125533017326545911_1102 src: /127.0.0.1:35999 dest: /127.0.0.1:49827
2013-10-31 20:33:18,419 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35999, dest: /127.0.0.1:49827, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0011_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2125533017326545911_1102, duration: 6676399
2013-10-31 20:33:18,420 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2125533017326545911_1102 terminating
2013-10-31 20:33:18,422 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40092, dest: /127.0.0.1:46399, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0011_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2125533017326545911_1102, duration: 8224675
2013-10-31 20:33:18,422 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-2125533017326545911_1102 size 1040
2013-10-31 20:33:18,422 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2125533017326545911_1102 terminating
2013-10-31 20:33:18,423 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-2125533017326545911_1102 size 1040
2013-10-31 20:33:18,423 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34601, dest: /127.0.0.1:37249, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0011_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2125533017326545911_1102, duration: 10632019
2013-10-31 20:33:18,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2125533017326545911_1102 terminating
2013-10-31 20:33:18,429 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-2125533017326545911_1102 size 1040
2013-10-31 20:33:18,429 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0011_r_000000_0
2013-10-31 20:33:18,429 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0011_r_000000_0
2013-10-31 20:33:18,479 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0011_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:33:18,479 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:33:19,483 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0011_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:33:19,484 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0011_r_000000_0
2013-10-31 20:33:20,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0 dst=null perm=null
2013-10-31 20:33:20,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:20,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:20,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary/_attempt_20131031202710049_0011_r_000000_0 dst=null perm=null
2013-10-31 20:33:21,000 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 13
2013-10-31 20:33:21,038 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 20:33:21,040 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 20:33:21,041 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0011_r_000000_0 is done.
2013-10-31 20:33:21,041 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0011_r_000000_0 was -1
2013-10-31 20:33:21,041 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:22,488 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0011_r_000000_0' has completed task_20131031202710049_0011_r_000000 successfully.
2013-10-31 20:33:22,492 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0011_m_000002_0' to tip task_20131031202710049_0011_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:33:22,495 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0011_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:33:22,495 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0011_m_000002_0 which needs 1 slots
2013-10-31 20:33:22,495 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0011_m_000002_0 which needs 1 slots
2013-10-31 20:33:22,525 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0011/attempt_20131031202710049_0011_m_000002_0. Attempting to reuse: jvm_20131031202710049_0011_m_847623924
2013-10-31 20:33:23,247 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0011_m_847623924 given task: attempt_20131031202710049_0011_m_000002_0
2013-10-31 20:33:23,357 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_m_000002_0 0.0%
2013-10-31 20:33:23,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_temporary dst=null perm=null
2013-10-31 20:33:23,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:23,379 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_SUCCESS from client DFSClient_attempt_20131031202710049_0011_m_000002_0
2013-10-31 20:33:23,379 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0011_m_000002_0
2013-10-31 20:33:23,384 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1844005119933000365 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1844005119933000365 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1844005119933000365 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1844005119933000365 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6454245876950858246 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6454245876950858246 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6454245876950858246 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6454245876950858246 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7845851509003246631 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:23,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7845851509003246631 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:23,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7845851509003246631 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:23,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2002484192113999050 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:23,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2002484192113999050 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:23,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2002484192113999050 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:23,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0011 dst=null perm=null
2013-10-31 20:33:25,453 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_6454245876950858246_1096 blk_2002484192113999050_1098 blk_7845851509003246631_1097 blk_-1844005119933000365_1095
2013-10-31 20:33:25,454 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_6454245876950858246_1096 blk_2002484192113999050_1098 blk_7845851509003246631_1097 blk_-1844005119933000365_1095
2013-10-31 20:33:26,329 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0011_m_000002_0 0.0% cleanup
2013-10-31 20:33:26,331 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0011_m_000002_0 is done.
2013-10-31 20:33:26,331 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0011_m_000002_0 was -1
2013-10-31 20:33:26,332 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:27,304 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1844005119933000365_1095 file build/test/data/dfs/data/data3/current/blk_-1844005119933000365 for deletion
2013-10-31 20:33:27,304 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2002484192113999050_1098 file build/test/data/dfs/data/data4/current/blk_2002484192113999050 for deletion
2013-10-31 20:33:27,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1844005119933000365_1095 at file build/test/data/dfs/data/data3/current/blk_-1844005119933000365
2013-10-31 20:33:27,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2002484192113999050_1098 at file build/test/data/dfs/data/data4/current/blk_2002484192113999050
2013-10-31 20:33:27,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6454245876950858246_1096 file build/test/data/dfs/data/data4/current/blk_6454245876950858246 for deletion
2013-10-31 20:33:27,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7845851509003246631_1097 file build/test/data/dfs/data/data3/current/blk_7845851509003246631 for deletion
2013-10-31 20:33:27,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6454245876950858246_1096 at file build/test/data/dfs/data/data4/current/blk_6454245876950858246
2013-10-31 20:33:27,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7845851509003246631_1097 at file build/test/data/dfs/data/data3/current/blk_7845851509003246631
2013-10-31 20:33:27,495 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0011_r_000000_0
2013-10-31 20:33:27,496 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0011_r_000000_0
2013-10-31 20:33:28,130 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1844005119933000365_1095 file build/test/data/dfs/data/data7/current/blk_-1844005119933000365 for deletion
2013-10-31 20:33:28,130 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2002484192113999050_1098 file build/test/data/dfs/data/data8/current/blk_2002484192113999050 for deletion
2013-10-31 20:33:28,130 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1844005119933000365_1095 at file build/test/data/dfs/data/data7/current/blk_-1844005119933000365
2013-10-31 20:33:28,131 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2002484192113999050_1098 at file build/test/data/dfs/data/data8/current/blk_2002484192113999050
2013-10-31 20:33:28,130 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6454245876950858246_1096 file build/test/data/dfs/data/data8/current/blk_6454245876950858246 for deletion
2013-10-31 20:33:28,131 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7845851509003246631_1097 file build/test/data/dfs/data/data7/current/blk_7845851509003246631 for deletion
2013-10-31 20:33:28,131 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6454245876950858246_1096 at file build/test/data/dfs/data/data8/current/blk_6454245876950858246
2013-10-31 20:33:28,132 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7845851509003246631_1097 at file build/test/data/dfs/data/data7/current/blk_7845851509003246631
2013-10-31 20:33:28,454 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_6454245876950858246_1096 blk_7845851509003246631_1097 blk_-1844005119933000365_1095
2013-10-31 20:33:28,454 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_6454245876950858246_1096 blk_2002484192113999050_1098 blk_-1844005119933000365_1095
2013-10-31 20:33:28,502 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0011_m_000002_0' has completed task_20131031202710049_0011_m_000002 successfully.
2013-10-31 20:33:28,554 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0011 has completed successfully.
2013-10-31 20:33:28,555 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0011,submitTime=1383251577534,launchTime=1383251577665,firstMapTaskLaunchTime=1383251584459,firstReduceTaskLaunchTime=1383251590471,firstJobSetupTaskLaunchTime=1383251578314,firstJobCleanupTaskLaunchTime=1383251602492,finishTime=1383251608554,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=17,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C6CE6AF4D3EE40948BD074130BC10DF6/1B96B904EEE64033920BFE897A56C8A3] lower*upper/(1/2)
2013-10-31 20:33:28,579 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_1383251577534_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F1B96B904EEE64033. blk_-7369850521968778834_1103
2013-10-31 20:33:28,583 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7369850521968778834_1103 src: /127.0.0.1:40097 dest: /127.0.0.1:46399
2013-10-31 20:33:28,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7369850521968778834_1103 src: /127.0.0.1:34608 dest: /127.0.0.1:37249
2013-10-31 20:33:28,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7369850521968778834_1103 src: /127.0.0.1:36005 dest: /127.0.0.1:49827
2013-10-31 20:33:28,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36005, dest: /127.0.0.1:49827, bytes: 20700, op: HDFS_WRITE, cliID: DFSClient_-643886743, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7369850521968778834_1103, duration: 4913951
2013-10-31 20:33:28,597 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7369850521968778834_1103 terminating
2013-10-31 20:33:28,597 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7369850521968778834_1103 size 20700
2013-10-31 20:33:28,598 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34608, dest: /127.0.0.1:37249, bytes: 20700, op: HDFS_WRITE, cliID: DFSClient_-643886743, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7369850521968778834_1103, duration: 5639510
2013-10-31 20:33:28,598 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7369850521968778834_1103 size 20700
2013-10-31 20:33:28,598 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7369850521968778834_1103 terminating
2013-10-31 20:33:28,600 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40097, dest: /127.0.0.1:46399, bytes: 20700, op: HDFS_WRITE, cliID: DFSClient_-643886743, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7369850521968778834_1103, duration: 9311927
2013-10-31 20:33:28,600 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7369850521968778834_1103 size 20700
2013-10-31 20:33:28,601 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7369850521968778834_1103 terminating
2013-10-31 20:33:28,605 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_1383251577534_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F1B96B904EEE64033 from client DFSClient_-643886743
2013-10-31 20:33:28,607 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/_logs/history/job_20131031202710049_0011_1383251577534_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F1B96B904EEE64033 is closed by DFSClient_-643886743
2013-10-31 20:33:28,614 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0011_1383251577534_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F1B96B904EEE64033 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:33:28,615 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0011_m_000000_0'
2013-10-31 20:33:28,615 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0011_m_000002_0'
2013-10-31 20:33:28,615 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0011_m_000003_0'
2013-10-31 20:33:28,616 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0011_r_000000_0'
2013-10-31 20:33:28,617 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2696325249328552901 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:28,617 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2696325249328552901 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:28,617 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2696325249328552901 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:28,621 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...value/true/true/true/true
2013-10-31 20:33:28,622 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0011_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:33:28,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0011 dst=null perm=null
2013-10-31 20:33:28,631 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:33:28,631 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:33:28,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:28,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:33:28,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,659 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar. blk_-4447072449859963724_1104
2013-10-31 20:33:28,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4447072449859963724_1104 src: /127.0.0.1:44393 dest: /127.0.0.1:33202
2013-10-31 20:33:28,662 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4447072449859963724_1104 src: /127.0.0.1:40102 dest: /127.0.0.1:46399
2013-10-31 20:33:28,664 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4447072449859963724_1104 src: /127.0.0.1:34613 dest: /127.0.0.1:37249
2013-10-31 20:33:28,672 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34613, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4447072449859963724_1104, duration: 4525749
2013-10-31 20:33:28,672 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4447072449859963724_1104 terminating
2013-10-31 20:33:28,674 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40102, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4447072449859963724_1104, duration: 6005106
2013-10-31 20:33:28,674 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4447072449859963724_1104 terminating
2013-10-31 20:33:28,674 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4447072449859963724_1104 size 238055
2013-10-31 20:33:28,675 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44393, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4447072449859963724_1104, duration: 7778867
2013-10-31 20:33:28,676 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4447072449859963724_1104 terminating
2013-10-31 20:33:28,677 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4447072449859963724_1104 size 238055
2013-10-31 20:33:28,677 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar from client DFSClient_848976415
2013-10-31 20:33:28,678 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar is closed by DFSClient_848976415
2013-10-31 20:33:28,679 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4447072449859963724_1104 size 238055
2013-10-31 20:33:28,684 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar. New replication is 10
2013-10-31 20:33:28,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar dst=null perm=null
2013-10-31 20:33:28,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,696 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:33:28,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B dst=null perm=null
2013-10-31 20:33:28,702 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:33:28,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/part-00000 dst=null perm=null
2013-10-31 20:33:28,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,716 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split. New replication is 10
2013-10-31 20:33:28,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split dst=null perm=null
2013-10-31 20:33:28,722 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split. blk_143460687113758803_1105
2013-10-31 20:33:28,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_143460687113758803_1105 src: /127.0.0.1:44396 dest: /127.0.0.1:33202
2013-10-31 20:33:28,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_143460687113758803_1105 src: /127.0.0.1:34615 dest: /127.0.0.1:37249
2013-10-31 20:33:28,727 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_143460687113758803_1105 src: /127.0.0.1:36012 dest: /127.0.0.1:49827
2013-10-31 20:33:28,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_143460687113758803_1105 src: /127.0.0.1:40107 dest: /127.0.0.1:46399
2013-10-31 20:33:28,733 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40107, dest: /127.0.0.1:46399, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_143460687113758803_1105, duration: 813788
2013-10-31 20:33:28,733 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_143460687113758803_1105 terminating
2013-10-31 20:33:28,734 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36012, dest: /127.0.0.1:49827, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_143460687113758803_1105, duration: 2304021
2013-10-31 20:33:28,735 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_143460687113758803_1105 terminating
2013-10-31 20:33:28,736 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34615, dest: /127.0.0.1:37249, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_143460687113758803_1105, duration: 4074780
2013-10-31 20:33:28,736 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_143460687113758803_1105 terminating
2013-10-31 20:33:28,738 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_143460687113758803_1105 size 358
2013-10-31 20:33:28,738 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44396, dest: /127.0.0.1:33202, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_143460687113758803_1105, duration: 6127096
2013-10-31 20:33:28,739 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_143460687113758803_1105 size 358
2013-10-31 20:33:28,739 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_143460687113758803_1105 terminating
2013-10-31 20:33:28,742 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_143460687113758803_1105 size 358
2013-10-31 20:33:28,743 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split from client DFSClient_848976415
2013-10-31 20:33:28,743 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split is closed by DFSClient_848976415
2013-10-31 20:33:28,744 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_143460687113758803_1105 size 358
2013-10-31 20:33:28,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,760 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.splitmetainfo. blk_7554809719383756521_1106
2013-10-31 20:33:28,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7554809719383756521_1106 src: /127.0.0.1:44400 dest: /127.0.0.1:33202
2013-10-31 20:33:28,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7554809719383756521_1106 src: /127.0.0.1:40109 dest: /127.0.0.1:46399
2013-10-31 20:33:28,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7554809719383756521_1106 src: /127.0.0.1:36016 dest: /127.0.0.1:49827
2013-10-31 20:33:28,770 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36016, dest: /127.0.0.1:49827, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7554809719383756521_1106, duration: 816966
2013-10-31 20:33:28,770 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7554809719383756521_1106 terminating
2013-10-31 20:33:28,771 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40109, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7554809719383756521_1106, duration: 4356659
2013-10-31 20:33:28,772 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7554809719383756521_1106 size 45
2013-10-31 20:33:28,772 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7554809719383756521_1106 terminating
2013-10-31 20:33:28,774 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44400, dest: /127.0.0.1:33202, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7554809719383756521_1106, duration: 6393521
2013-10-31 20:33:28,774 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7554809719383756521_1106 terminating
2013-10-31 20:33:28,777 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7554809719383756521_1106 size 45
2013-10-31 20:33:28,777 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:33:28,778 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:33:28,778 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7554809719383756521_1106 size 45
2013-10-31 20:33:28,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:28,801 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml. blk_-4692234621856560674_1107
2013-10-31 20:33:28,803 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4692234621856560674_1107 src: /127.0.0.1:36017 dest: /127.0.0.1:49827
2013-10-31 20:33:28,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4692234621856560674_1107 src: /127.0.0.1:44404 dest: /127.0.0.1:33202
2013-10-31 20:33:28,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4692234621856560674_1107 src: /127.0.0.1:40113 dest: /127.0.0.1:46399
2013-10-31 20:33:28,810 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40113, dest: /127.0.0.1:46399, bytes: 28889, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4692234621856560674_1107, duration: 878407
2013-10-31 20:33:28,810 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4692234621856560674_1107 terminating
2013-10-31 20:33:28,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44404, dest: /127.0.0.1:33202, bytes: 28889, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4692234621856560674_1107, duration: 2335104
2013-10-31 20:33:28,811 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4692234621856560674_1107 terminating
2013-10-31 20:33:28,813 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36017, dest: /127.0.0.1:49827, bytes: 28889, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4692234621856560674_1107, duration: 4124325
2013-10-31 20:33:28,813 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4692234621856560674_1107 size 28889
2013-10-31 20:33:28,813 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4692234621856560674_1107 terminating
2013-10-31 20:33:28,815 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4692234621856560674_1107 size 28889
2013-10-31 20:33:28,815 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml from client DFSClient_848976415
2013-10-31 20:33:28,816 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml is closed by DFSClient_848976415
2013-10-31 20:33:28,817 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4692234621856560674_1107 size 28889
2013-10-31 20:33:28,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml dst=null perm=null
2013-10-31 20:33:28,832 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40115, bytes: 29117, op: HDFS_READ, cliID: DFSClient_-477251705, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4692234621856560674_1107, duration: 380409
2013-10-31 20:33:28,852 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0012: nMaps=1 nReduces=1 max=-1
2013-10-31 20:33:28,852 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0012 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:33:28,852 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0012
2013-10-31 20:33:28,852 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0012 RESULT=SUCCESS
2013-10-31 20:33:28,853 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0012
2013-10-31 20:33:28,855 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0012
2013-10-31 20:33:29,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_1383251608822_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F7218433232274429 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:29,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:29,404 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_conf.xml. blk_3173178261845099687_1109
2013-10-31 20:33:29,406 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3173178261845099687_1109 src: /127.0.0.1:36022 dest: /127.0.0.1:49827
2013-10-31 20:33:29,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3173178261845099687_1109 src: /127.0.0.1:40117 dest: /127.0.0.1:46399
2013-10-31 20:33:29,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3173178261845099687_1109 src: /127.0.0.1:34628 dest: /127.0.0.1:37249
2013-10-31 20:33:29,414 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34628, dest: /127.0.0.1:37249, bytes: 28954, op: HDFS_WRITE, cliID: DFSClient_-477251705, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3173178261845099687_1109, duration: 1210620
2013-10-31 20:33:29,415 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3173178261845099687_1109 terminating
2013-10-31 20:33:29,415 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3173178261845099687_1109 size 28954
2013-10-31 20:33:29,416 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40117, dest: /127.0.0.1:46399, bytes: 28954, op: HDFS_WRITE, cliID: DFSClient_-477251705, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3173178261845099687_1109, duration: 2971497
2013-10-31 20:33:29,416 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3173178261845099687_1109 size 28954
2013-10-31 20:33:29,416 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3173178261845099687_1109 terminating
2013-10-31 20:33:29,418 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36022, dest: /127.0.0.1:49827, bytes: 28954, op: HDFS_WRITE, cliID: DFSClient_-477251705, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3173178261845099687_1109, duration: 4970197
2013-10-31 20:33:29,418 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3173178261845099687_1109 terminating
2013-10-31 20:33:29,421 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_conf.xml from client DFSClient_-477251705
2013-10-31 20:33:29,422 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_conf.xml is closed by DFSClient_-477251705
2013-10-31 20:33:29,422 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3173178261845099687_1109 size 28954
2013-10-31 20:33:29,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:29,439 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012/jobToken. blk_2444405827544130137_1110
2013-10-31 20:33:29,440 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2444405827544130137_1110 src: /127.0.0.1:44411 dest: /127.0.0.1:33202
2013-10-31 20:33:29,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2444405827544130137_1110 src: /127.0.0.1:34630 dest: /127.0.0.1:37249
2013-10-31 20:33:29,459 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2444405827544130137_1110 src: /127.0.0.1:40121 dest: /127.0.0.1:46399
2013-10-31 20:33:29,466 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40121, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2444405827544130137_1110, duration: 5499072
2013-10-31 20:33:29,467 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2444405827544130137_1110 terminating
2013-10-31 20:33:29,470 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2444405827544130137_1110 size 116
2013-10-31 20:33:29,471 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34630, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2444405827544130137_1110, duration: 3949030
2013-10-31 20:33:29,473 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2444405827544130137_1110 size 116
2013-10-31 20:33:29,473 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2444405827544130137_1110 terminating
2013-10-31 20:33:29,473 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44411, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2444405827544130137_1110, duration: 9698451
2013-10-31 20:33:29,475 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2444405827544130137_1110 terminating
2013-10-31 20:33:29,477 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012/jobToken from client DFSClient_848976415
2013-10-31 20:33:29,478 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012/jobToken is closed by DFSClient_848976415
2013-10-31 20:33:29,478 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2444405827544130137_1110 size 116
2013-10-31 20:33:29,483 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012/jobToken
2013-10-31 20:33:29,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.splitmetainfo dst=null perm=null
2013-10-31 20:33:29,487 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44414, bytes: 49, op: HDFS_READ, cliID: DFSClient_-477251705, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7554809719383756521_1106, duration: 270799
2013-10-31 20:33:29,488 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0012 = 1040. Number of splits = 1
2013-10-31 20:33:29,488 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:33:29,488 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:33:29,488 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:33:29,489 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0012 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:33:29,489 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0012 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:33:29,855 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0012_m_000002_0' to tip task_20131031202710049_0012_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:33:29,860 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0011_m_000001_0'
2013-10-31 20:33:29,861 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1844005119933000365_1095 file build/test/data/dfs/data/data1/current/blk_-1844005119933000365 for deletion
2013-10-31 20:33:29,862 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0012_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:33:29,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1844005119933000365_1095 at file build/test/data/dfs/data/data1/current/blk_-1844005119933000365
2013-10-31 20:33:29,862 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0012_m_000002_0 which needs 1 slots
2013-10-31 20:33:29,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2002484192113999050_1098 file build/test/data/dfs/data/data1/current/blk_2002484192113999050 for deletion
2013-10-31 20:33:29,862 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0012_m_000002_0 which needs 1 slots
2013-10-31 20:33:29,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2002484192113999050_1098 at file build/test/data/dfs/data/data1/current/blk_2002484192113999050
2013-10-31 20:33:29,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6454245876950858246_1096 file build/test/data/dfs/data/data2/current/blk_6454245876950858246 for deletion
2013-10-31 20:33:29,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6454245876950858246_1096 at file build/test/data/dfs/data/data2/current/blk_6454245876950858246
2013-10-31 20:33:29,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012/jobToken dst=null perm=null
2013-10-31 20:33:29,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34633, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2444405827544130137_1110, duration: 271934
2013-10-31 20:33:29,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.xml dst=null perm=null
2013-10-31 20:33:29,884 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44417, bytes: 29117, op: HDFS_READ, cliID: DFSClient_-275659728, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4692234621856560674_1107, duration: 404970
2013-10-31 20:33:29,916 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:33:29,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.jar dst=null perm=null
2013-10-31 20:33:29,947 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34636, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-275659728, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4447072449859963724_1104, duration: 959584
2013-10-31 20:33:30,032 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0012_m_-1885062531
2013-10-31 20:33:30,032 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0012_m_-1885062531 spawned.
2013-10-31 20:33:30,034 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0012/attempt_20131031202710049_0012_m_000002_0/taskjvm.sh
2013-10-31 20:33:30,248 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0011
2013-10-31 20:33:30,248 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0011 being deleted.
2013-10-31 20:33:30,521 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0011
2013-10-31 20:33:30,521 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0011 being deleted.
2013-10-31 20:33:30,750 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1844005119933000365_1095 file build/test/data/dfs/data/data5/current/blk_-1844005119933000365 for deletion
2013-10-31 20:33:30,750 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6454245876950858246_1096 file build/test/data/dfs/data/data5/current/blk_6454245876950858246 for deletion
2013-10-31 20:33:30,750 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1844005119933000365_1095 at file build/test/data/dfs/data/data5/current/blk_-1844005119933000365
2013-10-31 20:33:30,751 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7845851509003246631_1097 file build/test/data/dfs/data/data6/current/blk_7845851509003246631 for deletion
2013-10-31 20:33:30,751 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6454245876950858246_1096 at file build/test/data/dfs/data/data5/current/blk_6454245876950858246
2013-10-31 20:33:30,751 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7845851509003246631_1097 at file build/test/data/dfs/data/data6/current/blk_7845851509003246631
2013-10-31 20:33:31,446 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0012_m_-1885062531 given task: attempt_20131031202710049_0012_m_000002_0
2013-10-31 20:33:31,455 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:33202 to replicate blk_-4447072449859963724_1104 to datanode(s) 127.0.0.1:49827
2013-10-31 20:33:31,455 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_2696325249328552901_1101
2013-10-31 20:33:31,455 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_2696325249328552901_1101
2013-10-31 20:33:31,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:33,306 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909) Starting thread to transfer block blk_-4447072449859963724_1104 to 127.0.0.1:49827
2013-10-31 20:33:33,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4447072449859963724_1104 src: /127.0.0.1:36035 dest: /127.0.0.1:49827
2013-10-31 20:33:33,309 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909):Transmitted block blk_-4447072449859963724_1104 to /127.0.0.1:49827
2013-10-31 20:33:33,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4447072449859963724_1104 src: /127.0.0.1:36035 dest: /127.0.0.1:49827 of size 238055
2013-10-31 20:33:33,315 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4447072449859963724_1104 size 238055
2013-10-31 20:33:33,617 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0011
2013-10-31 20:33:33,618 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0011_m_000002_0 not found in cache
2013-10-31 20:33:33,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0011 for user-log deletion with retainTimeStamp:1383338013619
2013-10-31 20:33:33,751 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2696325249328552901_1101 file build/test/data/dfs/data/data6/current/blk_2696325249328552901 for deletion
2013-10-31 20:33:33,751 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2696325249328552901_1101 at file build/test/data/dfs/data/data6/current/blk_2696325249328552901
2013-10-31 20:33:34,132 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2696325249328552901_1101 file build/test/data/dfs/data/data7/current/blk_2696325249328552901 for deletion
2013-10-31 20:33:34,132 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2696325249328552901_1101 at file build/test/data/dfs/data/data7/current/blk_2696325249328552901
2013-10-31 20:33:34,372 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0011_m_847623924 since job job_20131031202710049_0011 is dead
2013-10-31 20:33:34,380 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30790 with signal TERM. Exit code 0
2013-10-31 20:33:34,456 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_2696325249328552901_1101
2013-10-31 20:33:34,579 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:34,579 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:34,579 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:34,579 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0011_m_847623924 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:33:34,855 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0011_m_-1723445986 since job job_20131031202710049_0011 is dead
2013-10-31 20:33:34,862 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0011
2013-10-31 20:33:34,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0011 for user-log deletion with retainTimeStamp:1383338014863
2013-10-31 20:33:34,864 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_m_000002_0 0.0% setup
2013-10-31 20:33:34,865 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30897 with signal TERM. Exit code 0
2013-10-31 20:33:34,867 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0012_m_000002_0 is done.
2013-10-31 20:33:34,867 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0012_m_000002_0 was -1
2013-10-31 20:33:34,867 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:35,077 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0011_r_3239044 since job job_20131031202710049_0011 is dead
2013-10-31 20:33:35,079 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:35,079 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:35,079 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:35,079 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0011_m_-1723445986 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:33:35,085 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31035 with signal TERM. Exit code 0
2013-10-31 20:33:35,211 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0011_m_864492490 since job job_20131031202710049_0011 is dead
2013-10-31 20:33:35,218 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30966 with signal TERM. Exit code 0
2013-10-31 20:33:35,277 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:35,277 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:35,277 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:35,277 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0011_r_3239044 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:33:35,478 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:33:35,478 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:33:35,478 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:33:35,479 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0011_m_864492490 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:33:35,860 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2696325249328552901_1101 file build/test/data/dfs/data/data1/current/blk_2696325249328552901 for deletion
2013-10-31 20:33:35,860 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2696325249328552901_1101 at file build/test/data/dfs/data/data1/current/blk_2696325249328552901
2013-10-31 20:33:35,869 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0012_m_000002_0' has completed task_20131031202710049_0012_m_000002 successfully.
2013-10-31 20:33:35,873 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0012_m_000000_0' to tip task_20131031202710049_0012_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:33:35,874 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0012_m_000000
2013-10-31 20:33:35,876 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0012_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:33:35,876 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0012_m_000000_0 which needs 1 slots
2013-10-31 20:33:35,876 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0012_m_000000_0 which needs 1 slots
2013-10-31 20:33:35,988 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0012_m_457612727
2013-10-31 20:33:35,989 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0012_m_457612727 spawned.
2013-10-31 20:33:35,992 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0012/attempt_20131031202710049_0012_m_000000_0/taskjvm.sh
2013-10-31 20:33:36,902 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0012_m_457612727 given task: attempt_20131031202710049_0012_m_000000_0
2013-10-31 20:33:37,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012/job.split dst=null perm=null
2013-10-31 20:33:37,398 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40135, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0012_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_143460687113758803_1105, duration: 125407
2013-10-31 20:33:37,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/part-00000 dst=null perm=null
2013-10-31 20:33:37,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34646, bytes: 1052, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0012_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2125533017326545911_1102, duration: 342637
2013-10-31 20:33:40,328 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B/part-00000:0+1040
2013-10-31 20:33:40,331 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0012_m_000000_0 is done.
2013-10-31 20:33:40,331 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0012_m_000000_0 was 1135
2013-10-31 20:33:40,331 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:40,876 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0012_m_000002_0
2013-10-31 20:33:40,877 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0012_m_000002_0
2013-10-31 20:33:40,877 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0012_m_000002_0 not found in cache
2013-10-31 20:33:41,705 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3037311813710157570_1002
2013-10-31 20:33:41,882 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0012_m_000000_0' has completed task_20131031202710049_0012_m_000000 successfully.
2013-10-31 20:33:41,884 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0012_r_000000_0' to tip task_20131031202710049_0012_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:33:41,887 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0012_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:33:41,887 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0012_r_000000_0 which needs 1 slots
2013-10-31 20:33:41,887 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0012_r_000000_0 which needs 1 slots
2013-10-31 20:33:41,922 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0012_r_-612834015
2013-10-31 20:33:41,922 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0012_r_-612834015 spawned.
2013-10-31 20:33:41,924 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0012/attempt_20131031202710049_0012_r_000000_0/taskjvm.sh
2013-10-31 20:33:42,768 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0012_r_-612834015 given task: attempt_20131031202710049_0012_r_000000_0
2013-10-31 20:33:48,471 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53689, bytes: 1135, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0012_m_000000_0, duration: 5876973
2013-10-31 20:33:49,264 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:33:49,330 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:33:49,389 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:33:49,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:49,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:49,612 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0/part-00000. blk_-1107293487215935643_1111
2013-10-31 20:33:49,646 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1107293487215935643_1111 src: /127.0.0.1:44432 dest: /127.0.0.1:33202
2013-10-31 20:33:49,648 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1107293487215935643_1111 src: /127.0.0.1:34651 dest: /127.0.0.1:37249
2013-10-31 20:33:49,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1107293487215935643_1111 src: /127.0.0.1:40142 dest: /127.0.0.1:46399
2013-10-31 20:33:49,658 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40142, dest: /127.0.0.1:46399, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0012_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1107293487215935643_1111, duration: 6750158
2013-10-31 20:33:49,659 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1107293487215935643_1111 terminating
2013-10-31 20:33:49,663 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34651, dest: /127.0.0.1:37249, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0012_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1107293487215935643_1111, duration: 8407701
2013-10-31 20:33:49,663 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1107293487215935643_1111 size 1040
2013-10-31 20:33:49,664 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1107293487215935643_1111 terminating
2013-10-31 20:33:49,665 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44432, dest: /127.0.0.1:33202, bytes: 1040, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0012_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1107293487215935643_1111, duration: 12559324
2013-10-31 20:33:49,665 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1107293487215935643_1111 terminating
2013-10-31 20:33:49,665 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1107293487215935643_1111 size 1040
2013-10-31 20:33:49,667 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1107293487215935643_1111 size 1040
2013-10-31 20:33:49,669 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0012_r_000000_0
2013-10-31 20:33:49,669 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0012_r_000000_0
2013-10-31 20:33:49,718 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0012_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:33:49,718 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:33:50,897 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0012_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:33:50,898 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0012_r_000000_0
2013-10-31 20:33:51,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0 dst=null perm=null
2013-10-31 20:33:51,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:33:51,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:51,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary/_attempt_20131031202710049_0012_r_000000_0 dst=null perm=null
2013-10-31 20:33:52,315 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_r_000000_0 1.0% reduce > reduce
2013-10-31 20:33:52,317 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_r_000000_0 1.0% reduce > reduce
2013-10-31 20:33:52,317 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0012_r_000000_0 is done.
2013-10-31 20:33:52,318 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0012_r_000000_0 was -1
2013-10-31 20:33:52,318 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:53,902 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0012_r_000000_0' has completed task_20131031202710049_0012_r_000000 successfully.
2013-10-31 20:33:53,906 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0012_m_000001_0' to tip task_20131031202710049_0012_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:33:53,908 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0012_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:33:53,909 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0012_m_000001_0 which needs 1 slots
2013-10-31 20:33:53,909 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0012_m_000001_0 which needs 1 slots
2013-10-31 20:33:53,943 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0012/attempt_20131031202710049_0012_m_000001_0. Attempting to reuse: jvm_20131031202710049_0012_m_457612727
2013-10-31 20:33:54,395 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0012_m_457612727 given task: attempt_20131031202710049_0012_m_000001_0
2013-10-31 20:33:54,519 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_m_000001_0 0.0%
2013-10-31 20:33:54,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary dst=null perm=null
2013-10-31 20:33:54,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:33:54,544 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_SUCCESS from client DFSClient_attempt_20131031202710049_0012_m_000001_0
2013-10-31 20:33:54,544 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0012_m_000001_0
2013-10-31 20:33:54,550 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4447072449859963724 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:54,550 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4447072449859963724 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4447072449859963724 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4447072449859963724 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_143460687113758803 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_143460687113758803 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_143460687113758803 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_143460687113758803 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:54,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7554809719383756521 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:54,552 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7554809719383756521 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:54,552 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7554809719383756521 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:54,552 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4692234621856560674 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:54,552 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4692234621856560674 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:54,552 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4692234621856560674 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:54,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0012 dst=null perm=null
2013-10-31 20:33:55,459 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-4447072449859963724_1104 blk_-4692234621856560674_1107 blk_7554809719383756521_1106 blk_143460687113758803_1105
2013-10-31 20:33:55,460 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-4447072449859963724_1104 blk_-4692234621856560674_1107 blk_7554809719383756521_1106 blk_143460687113758803_1105
2013-10-31 20:33:57,314 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4692234621856560674_1107 file build/test/data/dfs/data/data3/current/blk_-4692234621856560674 for deletion
2013-10-31 20:33:57,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4447072449859963724_1104 file build/test/data/dfs/data/data4/current/blk_-4447072449859963724 for deletion
2013-10-31 20:33:57,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4692234621856560674_1107 at file build/test/data/dfs/data/data3/current/blk_-4692234621856560674
2013-10-31 20:33:57,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_143460687113758803_1105 file build/test/data/dfs/data/data3/current/blk_143460687113758803 for deletion
2013-10-31 20:33:57,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4447072449859963724_1104 at file build/test/data/dfs/data/data4/current/blk_-4447072449859963724
2013-10-31 20:33:57,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_143460687113758803_1105 at file build/test/data/dfs/data/data3/current/blk_143460687113758803
2013-10-31 20:33:57,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7554809719383756521_1106 file build/test/data/dfs/data/data4/current/blk_7554809719383756521 for deletion
2013-10-31 20:33:57,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7554809719383756521_1106 at file build/test/data/dfs/data/data4/current/blk_7554809719383756521
2013-10-31 20:33:57,473 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0012_m_000001_0 0.0% cleanup
2013-10-31 20:33:57,475 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0012_m_000001_0 is done.
2013-10-31 20:33:57,475 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0012_m_000001_0 was -1
2013-10-31 20:33:57,475 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:33:57,759 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4692234621856560674_1107 file build/test/data/dfs/data/data5/current/blk_-4692234621856560674 for deletion
2013-10-31 20:33:57,759 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4447072449859963724_1104 file build/test/data/dfs/data/data6/current/blk_-4447072449859963724 for deletion
2013-10-31 20:33:57,759 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4692234621856560674_1107 at file build/test/data/dfs/data/data5/current/blk_-4692234621856560674
2013-10-31 20:33:57,759 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_143460687113758803_1105 file build/test/data/dfs/data/data5/current/blk_143460687113758803 for deletion
2013-10-31 20:33:57,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4447072449859963724_1104 at file build/test/data/dfs/data/data6/current/blk_-4447072449859963724
2013-10-31 20:33:57,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7554809719383756521_1106 file build/test/data/dfs/data/data6/current/blk_7554809719383756521 for deletion
2013-10-31 20:33:57,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_143460687113758803_1105 at file build/test/data/dfs/data/data5/current/blk_143460687113758803
2013-10-31 20:33:57,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7554809719383756521_1106 at file build/test/data/dfs/data/data6/current/blk_7554809719383756521
2013-10-31 20:33:58,460 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-4447072449859963724_1104 blk_-4692234621856560674_1107 blk_7554809719383756521_1106 blk_143460687113758803_1105
2013-10-31 20:33:58,461 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-4447072449859963724_1104 blk_143460687113758803_1105
2013-10-31 20:33:58,909 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0012_r_000000_0
2013-10-31 20:33:58,909 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0012_r_000000_0
2013-10-31 20:33:59,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4447072449859963724_1104 file build/test/data/dfs/data/data2/current/blk_-4447072449859963724 for deletion
2013-10-31 20:33:59,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_143460687113758803_1105 file build/test/data/dfs/data/data1/current/blk_143460687113758803 for deletion
2013-10-31 20:33:59,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4447072449859963724_1104 at file build/test/data/dfs/data/data2/current/blk_-4447072449859963724
2013-10-31 20:33:59,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_143460687113758803_1105 at file build/test/data/dfs/data/data1/current/blk_143460687113758803
2013-10-31 20:33:59,915 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0012_m_000001_0' has completed task_20131031202710049_0012_m_000001 successfully.
2013-10-31 20:33:59,917 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0012 has completed successfully.
2013-10-31 20:33:59,917 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0012,submitTime=1383251608822,launchTime=1383251609489,firstMapTaskLaunchTime=1383251615873,firstReduceTaskLaunchTime=1383251621884,firstJobSetupTaskLaunchTime=1383251609855,firstJobCleanupTaskLaunchTime=1383251633906,finishTime=1383251639917,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C6CE6AF4D3EE40948BD074130BC10DF6/72184332322744299E4E3E8A8D59E13F] lower*upper/(2/2) ...value/true/true/true/true
2013-10-31 20:33:59,923 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_1383251608822_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F7218433232274429. blk_2931358763061405043_1112
2013-10-31 20:33:59,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2931358763061405043_1112 src: /127.0.0.1:34657 dest: /127.0.0.1:37249
2013-10-31 20:33:59,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2931358763061405043_1112 src: /127.0.0.1:40148 dest: /127.0.0.1:46399
2013-10-31 20:33:59,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2931358763061405043_1112 src: /127.0.0.1:44441 dest: /127.0.0.1:33202
2013-10-31 20:33:59,941 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44441, dest: /127.0.0.1:33202, bytes: 16946, op: HDFS_WRITE, cliID: DFSClient_-477251705, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2931358763061405043_1112, duration: 6440517
2013-10-31 20:33:59,942 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2931358763061405043_1112 terminating
2013-10-31 20:33:59,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40148, dest: /127.0.0.1:46399, bytes: 16946, op: HDFS_WRITE, cliID: DFSClient_-477251705, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2931358763061405043_1112, duration: 6118748
2013-10-31 20:33:59,943 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2931358763061405043_1112 size 16946
2013-10-31 20:33:59,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2931358763061405043_1112 terminating
2013-10-31 20:33:59,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34657, dest: /127.0.0.1:37249, bytes: 16946, op: HDFS_WRITE, cliID: DFSClient_-477251705, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2931358763061405043_1112, duration: 9874412
2013-10-31 20:33:59,946 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2931358763061405043_1112 terminating
2013-10-31 20:33:59,946 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2931358763061405043_1112 size 16946
2013-10-31 20:33:59,949 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_1383251608822_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F7218433232274429 from client DFSClient_-477251705
2013-10-31 20:33:59,949 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_logs/history/job_20131031202710049_0012_1383251608822_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F7218433232274429 is closed by DFSClient_-477251705
2013-10-31 20:33:59,950 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2931358763061405043_1112 size 16946
2013-10-31 20:33:59,956 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0012_1383251608822_hadoop_%5BC6CE6AF4D3EE40948BD074130BC10DF6%2F7218433232274429 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:33:59,959 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0012_m_000000_0'
2013-10-31 20:33:59,959 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0012_m_000001_0'
2013-10-31 20:33:59,959 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0012_m_000002_0'
2013-10-31 20:33:59,960 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0012_r_000000_0'
2013-10-31 20:33:59,962 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2444405827544130137 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:59,962 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2444405827544130137 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:59,962 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2444405827544130137 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:59,967 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0012_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:33:59,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0012 dst=null perm=null
2013-10-31 20:33:59,971 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7369850521968778834 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:59,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7369850521968778834 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:59,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7369850521968778834 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:59,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7403607125588767935 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:59,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7403607125588767935 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:59,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7403607125588767935 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:33:59,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2125533017326545911 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:33:59,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2125533017326545911 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:33:59,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2125533017326545911 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:33:59,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7814954662_lower_upper_29D11EA688204B7DB53301A8C4ABC85B dst=null perm=null
2013-10-31 20:33:59,981 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/_temporary
2013-10-31 20:34:00,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true dst=null perm=null
2013-10-31 20:34:00,003 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:34:00,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/part-00000 dst=null perm=null
2013-10-31 20:34:00,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/part-00000 dst=null perm=null
2013-10-31 20:34:00,011 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40151, bytes: 1052, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1107293487215935643_1111, duration: 1919255
2013-10-31 20:34:00,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true dst=null perm=null
2013-10-31 20:34:00,032 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:34:00,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/part-00000 dst=null perm=null
2013-10-31 20:34:00,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/part-00000 dst=null perm=null
2013-10-31 20:34:00,037 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40152, bytes: 1052, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1107293487215935643_1111, duration: 151876
2013-10-31 20:34:00,038 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true
2013-10-31 20:34:00,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true dst=null perm=null
2013-10-31 20:34:00,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/true/true/part-00000 dst=null perm=null
2013-10-31 20:34:00,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40153, bytes: 1052, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1107293487215935643_1111, duration: 152175
2013-10-31 20:34:00,053 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:34:00,053 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:34:00,077 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:34:00,077 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:34:00,078 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:34:00,078 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false"]
2013-10-31 20:34:00,079 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:34:00,079 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:34:00,079 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:34:00,080 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:34:00,084 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:34:00,084 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:34:00,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:00,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:34:00,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,105 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar. blk_-7287552299518507654_1113
2013-10-31 20:34:00,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7287552299518507654_1113 src: /127.0.0.1:40154 dest: /127.0.0.1:46399
2013-10-31 20:34:00,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7287552299518507654_1113 src: /127.0.0.1:44447 dest: /127.0.0.1:33202
2013-10-31 20:34:00,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7287552299518507654_1113 src: /127.0.0.1:36062 dest: /127.0.0.1:49827
2013-10-31 20:34:00,122 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36062, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7287552299518507654_1113, duration: 7837893
2013-10-31 20:34:00,122 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7287552299518507654_1113 terminating
2013-10-31 20:34:00,123 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44447, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7287552299518507654_1113, duration: 9481387
2013-10-31 20:34:00,123 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7287552299518507654_1113 size 238055
2013-10-31 20:34:00,124 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7287552299518507654_1113 terminating
2013-10-31 20:34:00,125 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40154, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7287552299518507654_1113, duration: 11374173
2013-10-31 20:34:00,125 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7287552299518507654_1113 terminating
2013-10-31 20:34:00,125 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7287552299518507654_1113 size 238055
2013-10-31 20:34:00,127 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar from client DFSClient_848976415
2013-10-31 20:34:00,128 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar is closed by DFSClient_848976415
2013-10-31 20:34:00,128 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7287552299518507654_1113 size 238055
2013-10-31 20:34:00,133 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar. New replication is 10
2013-10-31 20:34:00,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar dst=null perm=null
2013-10-31 20:34:00,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,144 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:34:00,149 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:34:00,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:34:00,152 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:34:00,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:34:00,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,168 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split. New replication is 10
2013-10-31 20:34:00,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split dst=null perm=null
2013-10-31 20:34:00,176 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split. blk_6170874266049809539_1114
2013-10-31 20:34:00,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6170874266049809539_1114 src: /127.0.0.1:40157 dest: /127.0.0.1:46399
2013-10-31 20:34:00,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6170874266049809539_1114 src: /127.0.0.1:34668 dest: /127.0.0.1:37249
2013-10-31 20:34:00,181 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6170874266049809539_1114 src: /127.0.0.1:36065 dest: /127.0.0.1:49827
2013-10-31 20:34:00,183 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6170874266049809539_1114 src: /127.0.0.1:44452 dest: /127.0.0.1:33202
2013-10-31 20:34:00,187 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44452, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6170874266049809539_1114, duration: 952643
2013-10-31 20:34:00,187 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6170874266049809539_1114 terminating
2013-10-31 20:34:00,187 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6170874266049809539_1114 size 697
2013-10-31 20:34:00,189 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36065, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6170874266049809539_1114, duration: 2771894
2013-10-31 20:34:00,189 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6170874266049809539_1114 terminating
2013-10-31 20:34:00,191 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34668, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6170874266049809539_1114, duration: 4544292
2013-10-31 20:34:00,191 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6170874266049809539_1114 size 697
2013-10-31 20:34:00,191 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6170874266049809539_1114 terminating
2013-10-31 20:34:00,192 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40157, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6170874266049809539_1114, duration: 6319611
2013-10-31 20:34:00,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6170874266049809539_1114 size 697
2013-10-31 20:34:00,193 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6170874266049809539_1114 terminating
2013-10-31 20:34:00,197 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6170874266049809539_1114 size 697
2013-10-31 20:34:00,197 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split from client DFSClient_848976415
2013-10-31 20:34:00,198 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split is closed by DFSClient_848976415
2013-10-31 20:34:00,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,223 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.splitmetainfo. blk_2787968433030578623_1115
2013-10-31 20:34:00,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2787968433030578623_1115 src: /127.0.0.1:40161 dest: /127.0.0.1:46399
2013-10-31 20:34:00,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2787968433030578623_1115 src: /127.0.0.1:36068 dest: /127.0.0.1:49827
2013-10-31 20:34:00,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2787968433030578623_1115 src: /127.0.0.1:34673 dest: /127.0.0.1:37249
2013-10-31 20:34:00,231 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34673, dest: /127.0.0.1:37249, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2787968433030578623_1115, duration: 735670
2013-10-31 20:34:00,235 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2787968433030578623_1115 terminating
2013-10-31 20:34:00,235 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2787968433030578623_1115 size 78
2013-10-31 20:34:00,236 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36068, dest: /127.0.0.1:49827, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2787968433030578623_1115, duration: 5386617
2013-10-31 20:34:00,236 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2787968433030578623_1115 terminating
2013-10-31 20:34:00,238 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40161, dest: /127.0.0.1:46399, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2787968433030578623_1115, duration: 7112895
2013-10-31 20:34:00,238 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2787968433030578623_1115 terminating
2013-10-31 20:34:00,240 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:34:00,240 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:34:00,241 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2787968433030578623_1115 size 78
2013-10-31 20:34:00,241 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2787968433030578623_1115 size 78
2013-10-31 20:34:00,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,269 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml. blk_-4314432740026244915_1116
2013-10-31 20:34:00,271 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4314432740026244915_1116 src: /127.0.0.1:34674 dest: /127.0.0.1:37249
2013-10-31 20:34:00,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4314432740026244915_1116 src: /127.0.0.1:44457 dest: /127.0.0.1:33202
2013-10-31 20:34:00,274 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4314432740026244915_1116 src: /127.0.0.1:36072 dest: /127.0.0.1:49827
2013-10-31 20:34:00,278 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36072, dest: /127.0.0.1:49827, bytes: 29755, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4314432740026244915_1116, duration: 863290
2013-10-31 20:34:00,278 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4314432740026244915_1116 terminating
2013-10-31 20:34:00,280 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44457, dest: /127.0.0.1:33202, bytes: 29755, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4314432740026244915_1116, duration: 2513124
2013-10-31 20:34:00,280 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4314432740026244915_1116 terminating
2013-10-31 20:34:00,281 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34674, dest: /127.0.0.1:37249, bytes: 29755, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4314432740026244915_1116, duration: 4277729
2013-10-31 20:34:00,282 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4314432740026244915_1116 size 29755
2013-10-31 20:34:00,282 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4314432740026244915_1116 terminating
2013-10-31 20:34:00,285 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-4314432740026244915_1116 size 29755
2013-10-31 20:34:00,285 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0012
2013-10-31 20:34:00,286 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml from client DFSClient_848976415
2013-10-31 20:34:00,286 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0012 being deleted.
2013-10-31 20:34:00,286 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml is closed by DFSClient_848976415
2013-10-31 20:34:00,286 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4314432740026244915_1116 size 29755
2013-10-31 20:34:00,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml dst=null perm=null
2013-10-31 20:34:00,305 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44460, bytes: 29991, op: HDFS_READ, cliID: DFSClient_1942900974, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-4314432740026244915_1116, duration: 387599
2013-10-31 20:34:00,324 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0013: nMaps=2 nReduces=1 max=-1
2013-10-31 20:34:00,325 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0013 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:34:00,325 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0013
2013-10-31 20:34:00,325 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0013 RESULT=SUCCESS
2013-10-31 20:34:00,325 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0013
2013-10-31 20:34:00,327 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0013
2013-10-31 20:34:00,548 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0012
2013-10-31 20:34:00,549 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0012 being deleted.
2013-10-31 20:34:00,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_1383251640293_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F797660C5DF434F7D dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,863 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_conf.xml. blk_-8594137634848644750_1118
2013-10-31 20:34:00,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8594137634848644750_1118 src: /127.0.0.1:40169 dest: /127.0.0.1:46399
2013-10-31 20:34:00,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8594137634848644750_1118 src: /127.0.0.1:34680 dest: /127.0.0.1:37249
2013-10-31 20:34:00,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8594137634848644750_1118 src: /127.0.0.1:36077 dest: /127.0.0.1:49827
2013-10-31 20:34:00,874 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36077, dest: /127.0.0.1:49827, bytes: 29820, op: HDFS_WRITE, cliID: DFSClient_1942900974, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8594137634848644750_1118, duration: 1540196
2013-10-31 20:34:00,874 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8594137634848644750_1118 terminating
2013-10-31 20:34:00,876 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34680, dest: /127.0.0.1:37249, bytes: 29820, op: HDFS_WRITE, cliID: DFSClient_1942900974, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8594137634848644750_1118, duration: 3107294
2013-10-31 20:34:00,876 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8594137634848644750_1118 size 29820
2013-10-31 20:34:00,876 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8594137634848644750_1118 terminating
2013-10-31 20:34:00,877 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40169, dest: /127.0.0.1:46399, bytes: 29820, op: HDFS_WRITE, cliID: DFSClient_1942900974, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8594137634848644750_1118, duration: 5171588
2013-10-31 20:34:00,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8594137634848644750_1118 terminating
2013-10-31 20:34:00,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8594137634848644750_1118 size 29820
2013-10-31 20:34:00,880 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_conf.xml from client DFSClient_1942900974
2013-10-31 20:34:00,880 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_conf.xml is closed by DFSClient_1942900974
2013-10-31 20:34:00,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8594137634848644750_1118 size 29820
2013-10-31 20:34:00,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:00,893 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken. blk_-1291096700449495548_1119
2013-10-31 20:34:00,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1291096700449495548_1119 src: /127.0.0.1:40172 dest: /127.0.0.1:46399
2013-10-31 20:34:00,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1291096700449495548_1119 src: /127.0.0.1:34683 dest: /127.0.0.1:37249
2013-10-31 20:34:00,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1291096700449495548_1119 src: /127.0.0.1:44466 dest: /127.0.0.1:33202
2013-10-31 20:34:00,905 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44466, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1291096700449495548_1119, duration: 5989086
2013-10-31 20:34:00,905 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1291096700449495548_1119 terminating
2013-10-31 20:34:00,905 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34683, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1291096700449495548_1119, duration: 6359366
2013-10-31 20:34:00,905 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1291096700449495548_1119 terminating
2013-10-31 20:34:00,906 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40172, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1291096700449495548_1119, duration: 3676529
2013-10-31 20:34:00,906 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1291096700449495548_1119 terminating
2013-10-31 20:34:00,910 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1291096700449495548_1119 size 116
2013-10-31 20:34:00,910 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken from client DFSClient_848976415
2013-10-31 20:34:00,910 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken is closed by DFSClient_848976415
2013-10-31 20:34:00,910 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1291096700449495548_1119 size 116
2013-10-31 20:34:00,911 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1291096700449495548_1119 size 116
2013-10-31 20:34:00,916 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken
2013-10-31 20:34:00,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.splitmetainfo dst=null perm=null
2013-10-31 20:34:00,920 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36081, bytes: 82, op: HDFS_READ, cliID: DFSClient_1942900974, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2787968433030578623_1115, duration: 277239
2013-10-31 20:34:00,921 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0013 = 38. Number of splits = 2
2013-10-31 20:34:00,921 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:00,921 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:00,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:00,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:00,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:00,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:00,923 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0013 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:34:00,923 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0013 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:34:01,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4692234621856560674_1107 file build/test/data/dfs/data/data8/current/blk_-4692234621856560674 for deletion
2013-10-31 20:34:01,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4447072449859963724_1104 file build/test/data/dfs/data/data8/current/blk_-4447072449859963724 for deletion
2013-10-31 20:34:01,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4692234621856560674_1107 at file build/test/data/dfs/data/data8/current/blk_-4692234621856560674
2013-10-31 20:34:01,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_143460687113758803_1105 file build/test/data/dfs/data/data8/current/blk_143460687113758803 for deletion
2013-10-31 20:34:01,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7554809719383756521_1106 file build/test/data/dfs/data/data7/current/blk_7554809719383756521 for deletion
2013-10-31 20:34:01,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4447072449859963724_1104 at file build/test/data/dfs/data/data8/current/blk_-4447072449859963724
2013-10-31 20:34:01,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7554809719383756521_1106 at file build/test/data/dfs/data/data7/current/blk_7554809719383756521
2013-10-31 20:34:01,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_143460687113758803_1105 at file build/test/data/dfs/data/data8/current/blk_143460687113758803
2013-10-31 20:34:01,461 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:49827 to replicate blk_-7287552299518507654_1113 to datanode(s) 127.0.0.1:37249
2013-10-31 20:34:01,462 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-7403607125588767935_1100 blk_-7369850521968778834_1103 blk_2444405827544130137_1110 blk_-2125533017326545911_1102
2013-10-31 20:34:01,462 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-7369850521968778834_1103 blk_-2125533017326545911_1102
2013-10-31 20:34:01,649 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0013_m_000003_0' to tip task_20131031202710049_0013_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:34:01,655 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0013_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:34:01,656 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0013_m_000003_0 which needs 1 slots
2013-10-31 20:34:01,656 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0012
2013-10-31 20:34:01,656 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0013_m_000003_0 which needs 1 slots
2013-10-31 20:34:01,656 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0012 being deleted.
2013-10-31 20:34:01,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken dst=null perm=null
2013-10-31 20:34:01,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40176, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1291096700449495548_1119, duration: 286520
2013-10-31 20:34:01,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml dst=null perm=null
2013-10-31 20:34:01,678 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36084, bytes: 29991, op: HDFS_READ, cliID: DFSClient_-902191060, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4314432740026244915_1116, duration: 371975
2013-10-31 20:34:01,707 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:34:01,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar dst=null perm=null
2013-10-31 20:34:01,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40179, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-902191060, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7287552299518507654_1113, duration: 1486011
2013-10-31 20:34:01,832 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0013_m_-1080452451
2013-10-31 20:34:01,833 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0013_m_-1080452451 spawned.
2013-10-31 20:34:01,836 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0013/attempt_20131031202710049_0013_m_000003_0/taskjvm.sh
2013-10-31 20:34:03,165 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0013_m_-1080452451 given task: attempt_20131031202710049_0013_m_000003_0
2013-10-31 20:34:03,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:03,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7403607125588767935_1100 file build/test/data/dfs/data/data5/current/blk_-7403607125588767935 for deletion
2013-10-31 20:34:03,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7369850521968778834_1103 file build/test/data/dfs/data/data5/current/blk_-7369850521968778834 for deletion
2013-10-31 20:34:03,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7403607125588767935_1100 at file build/test/data/dfs/data/data5/current/blk_-7403607125588767935
2013-10-31 20:34:03,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2125533017326545911_1102 file build/test/data/dfs/data/data6/current/blk_-2125533017326545911 for deletion
2013-10-31 20:34:03,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7369850521968778834_1103 at file build/test/data/dfs/data/data5/current/blk_-7369850521968778834
2013-10-31 20:34:03,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2444405827544130137_1110 file build/test/data/dfs/data/data5/current/blk_2444405827544130137 for deletion
2013-10-31 20:34:03,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2125533017326545911_1102 at file build/test/data/dfs/data/data6/current/blk_-2125533017326545911
2013-10-31 20:34:03,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2444405827544130137_1110 at file build/test/data/dfs/data/data5/current/blk_2444405827544130137
2013-10-31 20:34:04,142 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207) Starting thread to transfer block blk_-7287552299518507654_1113 to 127.0.0.1:37249
2013-10-31 20:34:04,143 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7369850521968778834_1103 file build/test/data/dfs/data/data7/current/blk_-7369850521968778834 for deletion
2013-10-31 20:34:04,143 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2125533017326545911_1102 file build/test/data/dfs/data/data8/current/blk_-2125533017326545911 for deletion
2013-10-31 20:34:04,143 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7369850521968778834_1103 at file build/test/data/dfs/data/data7/current/blk_-7369850521968778834
2013-10-31 20:34:04,143 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2125533017326545911_1102 at file build/test/data/dfs/data/data8/current/blk_-2125533017326545911
2013-10-31 20:34:04,144 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207):Transmitted block blk_-7287552299518507654_1113 to /127.0.0.1:37249
2013-10-31 20:34:04,145 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7287552299518507654_1113 src: /127.0.0.1:34692 dest: /127.0.0.1:37249
2013-10-31 20:34:04,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-7287552299518507654_1113 src: /127.0.0.1:34692 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:34:04,151 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7287552299518507654_1113 size 238055
2013-10-31 20:34:04,463 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-7403607125588767935_1100 blk_2444405827544130137_1110
2013-10-31 20:34:04,463 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-7403607125588767935_1100 blk_-7369850521968778834_1103 blk_2444405827544130137_1110 blk_-2125533017326545911_1102
2013-10-31 20:34:04,962 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0012
2013-10-31 20:34:04,963 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0012_m_000001_0 not found in cache
2013-10-31 20:34:04,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0012 for user-log deletion with retainTimeStamp:1383338044963
2013-10-31 20:34:05,452 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0012_m_-1885062531 since job job_20131031202710049_0012 is dead
2013-10-31 20:34:05,463 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31221 with signal TERM. Exit code 0
2013-10-31 20:34:05,512 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0012_m_457612727 since job job_20131031202710049_0012 is dead
2013-10-31 20:34:05,516 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31346 with signal TERM. Exit code 0
2013-10-31 20:34:05,630 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:05,631 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:05,631 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:05,631 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0012_m_-1885062531 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:34:05,662 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:05,662 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:05,662 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:05,662 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0012_m_457612727 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:34:05,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7403607125588767935_1100 file build/test/data/dfs/data/data2/current/blk_-7403607125588767935 for deletion
2013-10-31 20:34:05,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7369850521968778834_1103 file build/test/data/dfs/data/data1/current/blk_-7369850521968778834 for deletion
2013-10-31 20:34:05,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7403607125588767935_1100 at file build/test/data/dfs/data/data2/current/blk_-7403607125588767935
2013-10-31 20:34:05,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7369850521968778834_1103 at file build/test/data/dfs/data/data1/current/blk_-7369850521968778834
2013-10-31 20:34:05,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2125533017326545911_1102 file build/test/data/dfs/data/data2/current/blk_-2125533017326545911 for deletion
2013-10-31 20:34:05,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2444405827544130137_1110 file build/test/data/dfs/data/data1/current/blk_2444405827544130137 for deletion
2013-10-31 20:34:05,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2125533017326545911_1102 at file build/test/data/dfs/data/data2/current/blk_-2125533017326545911
2013-10-31 20:34:05,872 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2444405827544130137_1110 at file build/test/data/dfs/data/data1/current/blk_2444405827544130137
2013-10-31 20:34:06,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7403607125588767935_1100 file build/test/data/dfs/data/data3/current/blk_-7403607125588767935 for deletion
2013-10-31 20:34:06,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2444405827544130137_1110 file build/test/data/dfs/data/data4/current/blk_2444405827544130137 for deletion
2013-10-31 20:34:06,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7403607125588767935_1100 at file build/test/data/dfs/data/data3/current/blk_-7403607125588767935
2013-10-31 20:34:06,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2444405827544130137_1110 at file build/test/data/dfs/data/data4/current/blk_2444405827544130137
2013-10-31 20:34:06,351 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0012_r_-612834015 since job job_20131031202710049_0012 is dead
2013-10-31 20:34:06,361 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31416 with signal TERM. Exit code 0
2013-10-31 20:34:06,545 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:06,545 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:06,545 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:06,545 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0012_r_-612834015 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:34:06,581 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_m_000003_0 0.0% setup
2013-10-31 20:34:06,584 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0013_m_000003_0 is done.
2013-10-31 20:34:06,584 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0013_m_000003_0 was -1
2013-10-31 20:34:06,584 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:07,661 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0013_m_000003_0' has completed task_20131031202710049_0013_m_000003 successfully.
2013-10-31 20:34:07,665 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0013_m_000000_0' to tip task_20131031202710049_0013_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:34:07,666 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0013_m_000000
2013-10-31 20:34:07,667 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0013_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:34:07,668 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0013_m_000000_0 which needs 1 slots
2013-10-31 20:34:07,668 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0013_m_000000_0 which needs 1 slots
2013-10-31 20:34:07,702 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0013_m_-1411194620
2013-10-31 20:34:07,703 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0013_m_-1411194620 spawned.
2013-10-31 20:34:07,706 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0013/attempt_20131031202710049_0013_m_000000_0/taskjvm.sh
2013-10-31 20:34:08,051 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:34:08,059 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:34:08,065 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:34:08,070 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:34:08,076 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:34:08,081 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:34:08,087 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:34:08,087 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:34:08,957 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0013_m_-1411194620 given task: attempt_20131031202710049_0013_m_000000_0
2013-10-31 20:34:08,971 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0013_m_000001_0' to tip task_20131031202710049_0013_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:34:08,972 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0013_m_000001
2013-10-31 20:34:08,973 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0013_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:34:08,974 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0013_m_000001_0 which needs 1 slots
2013-10-31 20:34:08,974 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0013_m_000001_0 which needs 1 slots
2013-10-31 20:34:08,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013/jobToken dst=null perm=null
2013-10-31 20:34:08,982 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34694, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1291096700449495548_1119, duration: 282748
2013-10-31 20:34:08,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.xml dst=null perm=null
2013-10-31 20:34:08,993 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36092, bytes: 29991, op: HDFS_READ, cliID: DFSClient_-1207101372, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4314432740026244915_1116, duration: 363395
2013-10-31 20:34:09,020 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:34:09,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.jar dst=null perm=null
2013-10-31 20:34:09,035 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44479, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1207101372, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7287552299518507654_1113, duration: 716423
2013-10-31 20:34:09,099 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0013_m_917077929
2013-10-31 20:34:09,099 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0013_m_917077929 spawned.
2013-10-31 20:34:09,100 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0013/attempt_20131031202710049_0013_m_000001_0/taskjvm.sh
2013-10-31 20:34:09,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split dst=null perm=null
2013-10-31 20:34:09,816 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34699, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0013_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6170874266049809539_1114, duration: 164988
2013-10-31 20:34:09,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:34:10,111 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34700, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0013_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4376294229090259720_1013, duration: 127417
2013-10-31 20:34:10,363 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0013_m_917077929 given task: attempt_20131031202710049_0013_m_000001_0
2013-10-31 20:34:10,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013/job.split dst=null perm=null
2013-10-31 20:34:10,877 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44485, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0013_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6170874266049809539_1114, duration: 230341
2013-10-31 20:34:10,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:34:11,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36100, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0013_m_000001_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 103692
2013-10-31 20:34:12,668 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0013_m_000003_0
2013-10-31 20:34:12,668 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0013_m_000003_0
2013-10-31 20:34:12,669 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0013_m_000003_0 not found in cache
2013-10-31 20:34:12,745 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:34:12,749 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0013_m_000000_0 is done.
2013-10-31 20:34:12,749 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0013_m_000000_0 was 335
2013-10-31 20:34:12,749 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:13,672 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0013_m_000000_0' has completed task_20131031202710049_0013_m_000000 successfully.
2013-10-31 20:34:13,675 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0013_r_000000_0' to tip task_20131031202710049_0013_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:34:13,677 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0013_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:34:13,677 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0013_r_000000_0 which needs 1 slots
2013-10-31 20:34:13,678 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0013_r_000000_0 which needs 1 slots
2013-10-31 20:34:13,717 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0013_r_-218308890
2013-10-31 20:34:13,718 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0013_r_-218308890 spawned.
2013-10-31 20:34:13,719 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0013/attempt_20131031202710049_0013_r_000000_0/taskjvm.sh
2013-10-31 20:34:13,796 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:34:13,798 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0013_m_000001_0 is done.
2013-10-31 20:34:13,799 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0013_m_000001_0 was 335
2013-10-31 20:34:13,799 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:14,950 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0013_r_-218308890 given task: attempt_20131031202710049_0013_r_000000_0
2013-10-31 20:34:14,978 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0013_m_000001_0' has completed task_20131031202710049_0013_m_000001 successfully.
2013-10-31 20:34:20,611 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53374, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0013_m_000000_0, duration: 6044128
2013-10-31 20:34:20,624 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53749, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0013_m_000001_0, duration: 7065315
2013-10-31 20:34:21,423 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:34:21,467 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:34:21,548 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:34:21,726 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 633 Total time for transactions(ms): 13Number of transactions batched in Syncs: 21 Number of syncs: 434 SyncTimes(ms): 9068 2081
2013-10-31 20:34:21,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:21,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:21,775 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0/part-00000. blk_4718961324494384221_1120
2013-10-31 20:34:21,809 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4718961324494384221_1120 src: /127.0.0.1:44492 dest: /127.0.0.1:33202
2013-10-31 20:34:21,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4718961324494384221_1120 src: /127.0.0.1:34711 dest: /127.0.0.1:37249
2013-10-31 20:34:21,812 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4718961324494384221_1120 src: /127.0.0.1:36108 dest: /127.0.0.1:49827
2013-10-31 20:34:21,820 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36108, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0013_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4718961324494384221_1120, duration: 6120771
2013-10-31 20:34:21,821 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4718961324494384221_1120 terminating
2013-10-31 20:34:21,822 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34711, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0013_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4718961324494384221_1120, duration: 7860070
2013-10-31 20:34:21,822 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_4718961324494384221_1120 size 708
2013-10-31 20:34:21,822 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4718961324494384221_1120 terminating
2013-10-31 20:34:21,824 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_4718961324494384221_1120 size 708
2013-10-31 20:34:21,824 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44492, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0013_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4718961324494384221_1120, duration: 9663798
2013-10-31 20:34:21,824 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4718961324494384221_1120 terminating
2013-10-31 20:34:21,829 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_4718961324494384221_1120 size 708
2013-10-31 20:34:21,829 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0013_r_000000_0
2013-10-31 20:34:21,829 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0013_r_000000_0
2013-10-31 20:34:21,880 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0013_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:34:21,880 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:34:22,687 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0013_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:34:22,688 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0013_r_000000_0
2013-10-31 20:34:22,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0 dst=null perm=null
2013-10-31 20:34:22,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:22,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:22,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary/_attempt_20131031202710049_0013_r_000000_0 dst=null perm=null
2013-10-31 20:34:24,476 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_r_000000_0 1.0% reduce > reduce
2013-10-31 20:34:24,478 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_r_000000_0 1.0% reduce > reduce
2013-10-31 20:34:24,479 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0013_r_000000_0 is done.
2013-10-31 20:34:24,479 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0013_r_000000_0 was -1
2013-10-31 20:34:24,479 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:25,692 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0013_r_000000_0' has completed task_20131031202710049_0013_r_000000 successfully.
2013-10-31 20:34:25,697 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0013_m_000002_0' to tip task_20131031202710049_0013_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:34:25,700 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0013_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:34:25,701 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0013_m_000002_0 which needs 1 slots
2013-10-31 20:34:25,701 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0013_m_000002_0 which needs 1 slots
2013-10-31 20:34:25,739 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0013/attempt_20131031202710049_0013_m_000002_0. Attempting to reuse: jvm_20131031202710049_0013_m_-1080452451
2013-10-31 20:34:26,664 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0013_m_-1080452451 given task: attempt_20131031202710049_0013_m_000002_0
2013-10-31 20:34:26,773 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_m_000002_0 0.0%
2013-10-31 20:34:26,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_temporary dst=null perm=null
2013-10-31 20:34:26,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:26,802 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_SUCCESS from client DFSClient_attempt_20131031202710049_0013_m_000002_0
2013-10-31 20:34:26,803 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0013_m_000002_0
2013-10-31 20:34:26,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7287552299518507654 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:26,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7287552299518507654 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:26,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7287552299518507654 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:26,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7287552299518507654 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:26,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6170874266049809539 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:26,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6170874266049809539 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:26,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6170874266049809539 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:26,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6170874266049809539 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:26,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2787968433030578623 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:26,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2787968433030578623 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:26,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2787968433030578623 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:26,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4314432740026244915 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:26,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4314432740026244915 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:26,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4314432740026244915 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:26,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0013 dst=null perm=null
2013-10-31 20:34:28,467 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_2787968433030578623_1115 blk_6170874266049809539_1114 blk_-7287552299518507654_1113
2013-10-31 20:34:28,467 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-4314432740026244915_1116 blk_6170874266049809539_1114 blk_-7287552299518507654_1113
2013-10-31 20:34:29,745 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0013_m_000002_0 0.0% cleanup
2013-10-31 20:34:29,747 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0013_m_000002_0 is done.
2013-10-31 20:34:29,747 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0013_m_000002_0 was -1
2013-10-31 20:34:29,747 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:30,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7287552299518507654_1113 file build/test/data/dfs/data/data3/current/blk_-7287552299518507654 for deletion
2013-10-31 20:34:30,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4314432740026244915_1116 file build/test/data/dfs/data/data3/current/blk_-4314432740026244915 for deletion
2013-10-31 20:34:30,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7287552299518507654_1113 at file build/test/data/dfs/data/data3/current/blk_-7287552299518507654
2013-10-31 20:34:30,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6170874266049809539_1114 file build/test/data/dfs/data/data4/current/blk_6170874266049809539 for deletion
2013-10-31 20:34:30,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4314432740026244915_1116 at file build/test/data/dfs/data/data3/current/blk_-4314432740026244915
2013-10-31 20:34:30,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6170874266049809539_1114 at file build/test/data/dfs/data/data4/current/blk_6170874266049809539
2013-10-31 20:34:30,701 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0013_r_000000_0
2013-10-31 20:34:30,701 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0013_r_000000_0
2013-10-31 20:34:30,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7287552299518507654_1113 file build/test/data/dfs/data/data6/current/blk_-7287552299518507654 for deletion
2013-10-31 20:34:30,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2787968433030578623_1115 file build/test/data/dfs/data/data6/current/blk_2787968433030578623 for deletion
2013-10-31 20:34:30,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7287552299518507654_1113 at file build/test/data/dfs/data/data6/current/blk_-7287552299518507654
2013-10-31 20:34:30,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6170874266049809539_1114 file build/test/data/dfs/data/data5/current/blk_6170874266049809539 for deletion
2013-10-31 20:34:30,771 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2787968433030578623_1115 at file build/test/data/dfs/data/data6/current/blk_2787968433030578623
2013-10-31 20:34:30,771 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6170874266049809539_1114 at file build/test/data/dfs/data/data5/current/blk_6170874266049809539
2013-10-31 20:34:31,468 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_2787968433030578623_1115 blk_-4314432740026244915_1116 blk_6170874266049809539_1114 blk_-7287552299518507654_1113
2013-10-31 20:34:31,468 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_2787968433030578623_1115 blk_-4314432740026244915_1116 blk_6170874266049809539_1114 blk_-7287552299518507654_1113
2013-10-31 20:34:31,707 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0013_m_000002_0' has completed task_20131031202710049_0013_m_000002 successfully.
2013-10-31 20:34:31,708 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0013 has completed successfully.
2013-10-31 20:34:31,709 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0013,submitTime=1383251640293,launchTime=1383251640923,firstMapTaskLaunchTime=1383251647664,firstReduceTaskLaunchTime=1383251653674,firstJobSetupTaskLaunchTime=1383251641649,firstJobCleanupTaskLaunchTime=1383251665697,finishTime=1383251671708,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=18,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[20CC04FCE8284B1BB74FAE59442CCC95/797660C5DF434F7DA97CF0A5964CDEB5] lower*upper/(1/2)
2013-10-31 20:34:31,715 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_1383251640293_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F797660C5DF434F7D. blk_-7410404075519366896_1121
2013-10-31 20:34:31,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7410404075519366896_1121 src: /127.0.0.1:36112 dest: /127.0.0.1:49827
2013-10-31 20:34:31,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7410404075519366896_1121 src: /127.0.0.1:40207 dest: /127.0.0.1:46399
2013-10-31 20:34:31,726 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7410404075519366896_1121 src: /127.0.0.1:44500 dest: /127.0.0.1:33202
2013-10-31 20:34:31,730 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44500, dest: /127.0.0.1:33202, bytes: 20682, op: HDFS_WRITE, cliID: DFSClient_1942900974, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7410404075519366896_1121, duration: 761798
2013-10-31 20:34:31,730 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7410404075519366896_1121 terminating
2013-10-31 20:34:31,730 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7410404075519366896_1121 size 20682
2013-10-31 20:34:31,731 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40207, dest: /127.0.0.1:46399, bytes: 20682, op: HDFS_WRITE, cliID: DFSClient_1942900974, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7410404075519366896_1121, duration: 2375908
2013-10-31 20:34:31,732 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7410404075519366896_1121 size 20682
2013-10-31 20:34:31,732 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7410404075519366896_1121 terminating
2013-10-31 20:34:31,733 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36112, dest: /127.0.0.1:49827, bytes: 20682, op: HDFS_WRITE, cliID: DFSClient_1942900974, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7410404075519366896_1121, duration: 4277673
2013-10-31 20:34:31,734 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7410404075519366896_1121 terminating
2013-10-31 20:34:31,736 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_1383251640293_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F797660C5DF434F7D from client DFSClient_1942900974
2013-10-31 20:34:31,737 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/_logs/history/job_20131031202710049_0013_1383251640293_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F797660C5DF434F7D is closed by DFSClient_1942900974
2013-10-31 20:34:31,738 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7410404075519366896_1121 size 20682
2013-10-31 20:34:31,743 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0013_1383251640293_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F797660C5DF434F7D to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:34:31,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0013_m_000000_0'
2013-10-31 20:34:31,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0013_m_000002_0'
2013-10-31 20:34:31,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0013_m_000003_0'
2013-10-31 20:34:31,745 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0013_r_000000_0'
2013-10-31 20:34:31,746 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1291096700449495548 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:31,746 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1291096700449495548 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:31,746 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1291096700449495548 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:31,750 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...e/false/false/false/false
2013-10-31 20:34:31,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0013 dst=null perm=null
2013-10-31 20:34:31,752 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0013_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:34:31,761 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:34:31,761 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:34:31,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:31,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:34:31,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,851 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar. blk_7823287138518006582_1122
2013-10-31 20:34:31,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7823287138518006582_1122 src: /127.0.0.1:36116 dest: /127.0.0.1:49827
2013-10-31 20:34:31,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7823287138518006582_1122 src: /127.0.0.1:34721 dest: /127.0.0.1:37249
2013-10-31 20:34:31,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7823287138518006582_1122 src: /127.0.0.1:40212 dest: /127.0.0.1:46399
2013-10-31 20:34:31,864 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40212, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7823287138518006582_1122, duration: 4571153
2013-10-31 20:34:31,864 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7823287138518006582_1122 terminating
2013-10-31 20:34:31,866 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34721, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7823287138518006582_1122, duration: 6088155
2013-10-31 20:34:31,866 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7823287138518006582_1122 terminating
2013-10-31 20:34:31,867 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36116, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7823287138518006582_1122, duration: 7858881
2013-10-31 20:34:31,867 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7823287138518006582_1122 size 238055
2013-10-31 20:34:31,868 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7823287138518006582_1122 terminating
2013-10-31 20:34:31,869 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar from client DFSClient_848976415
2013-10-31 20:34:31,870 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar is closed by DFSClient_848976415
2013-10-31 20:34:31,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7823287138518006582_1122 size 238055
2013-10-31 20:34:31,872 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7823287138518006582_1122 size 238055
2013-10-31 20:34:31,875 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar. New replication is 10
2013-10-31 20:34:31,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar dst=null perm=null
2013-10-31 20:34:31,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,885 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:34:31,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854 dst=null perm=null
2013-10-31 20:34:31,892 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:34:31,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/part-00000 dst=null perm=null
2013-10-31 20:34:31,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,905 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split. New replication is 10
2013-10-31 20:34:31,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split dst=null perm=null
2013-10-31 20:34:31,913 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split. blk_-8792267483495418095_1123
2013-10-31 20:34:31,914 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8792267483495418095_1123 src: /127.0.0.1:34723 dest: /127.0.0.1:37249
2013-10-31 20:34:31,916 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8792267483495418095_1123 src: /127.0.0.1:44506 dest: /127.0.0.1:33202
2013-10-31 20:34:31,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8792267483495418095_1123 src: /127.0.0.1:40215 dest: /127.0.0.1:46399
2013-10-31 20:34:31,919 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8792267483495418095_1123 src: /127.0.0.1:36122 dest: /127.0.0.1:49827
2013-10-31 20:34:31,923 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36122, dest: /127.0.0.1:49827, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8792267483495418095_1123, duration: 995439
2013-10-31 20:34:31,924 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8792267483495418095_1123 terminating
2013-10-31 20:34:31,924 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8792267483495418095_1123 size 358
2013-10-31 20:34:31,925 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40215, dest: /127.0.0.1:46399, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8792267483495418095_1123, duration: 2715065
2013-10-31 20:34:31,925 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8792267483495418095_1123 terminating
2013-10-31 20:34:31,926 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44506, dest: /127.0.0.1:33202, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8792267483495418095_1123, duration: 4262061
2013-10-31 20:34:31,927 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8792267483495418095_1123 terminating
2013-10-31 20:34:31,928 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34723, dest: /127.0.0.1:37249, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8792267483495418095_1123, duration: 6107657
2013-10-31 20:34:31,929 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8792267483495418095_1123 size 358
2013-10-31 20:34:31,929 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8792267483495418095_1123 terminating
2013-10-31 20:34:31,931 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8792267483495418095_1123 size 358
2013-10-31 20:34:31,936 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split from client DFSClient_848976415
2013-10-31 20:34:31,936 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split is closed by DFSClient_848976415
2013-10-31 20:34:31,937 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8792267483495418095_1123 size 358
2013-10-31 20:34:31,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,960 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.splitmetainfo. blk_-8033824461140168631_1124
2013-10-31 20:34:31,961 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8033824461140168631_1124 src: /127.0.0.1:36123 dest: /127.0.0.1:49827
2013-10-31 20:34:31,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8033824461140168631_1124 src: /127.0.0.1:40218 dest: /127.0.0.1:46399
2013-10-31 20:34:31,964 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8033824461140168631_1124 src: /127.0.0.1:44511 dest: /127.0.0.1:33202
2013-10-31 20:34:31,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44511, dest: /127.0.0.1:33202, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8033824461140168631_1124, duration: 685102
2013-10-31 20:34:31,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8033824461140168631_1124 terminating
2013-10-31 20:34:31,969 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8033824461140168631_1124 size 45
2013-10-31 20:34:31,969 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40218, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8033824461140168631_1124, duration: 2449761
2013-10-31 20:34:31,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8033824461140168631_1124 terminating
2013-10-31 20:34:31,971 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36123, dest: /127.0.0.1:49827, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8033824461140168631_1124, duration: 4312223
2013-10-31 20:34:31,972 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8033824461140168631_1124 terminating
2013-10-31 20:34:31,973 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8033824461140168631_1124 size 45
2013-10-31 20:34:31,974 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:34:31,974 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:34:31,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8033824461140168631_1124 size 45
2013-10-31 20:34:31,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:31,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:32,000 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml. blk_2129416193303068834_1125
2013-10-31 20:34:32,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2129416193303068834_1125 src: /127.0.0.1:40220 dest: /127.0.0.1:46399
2013-10-31 20:34:32,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2129416193303068834_1125 src: /127.0.0.1:44513 dest: /127.0.0.1:33202
2013-10-31 20:34:32,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2129416193303068834_1125 src: /127.0.0.1:34732 dest: /127.0.0.1:37249
2013-10-31 20:34:32,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34732, dest: /127.0.0.1:37249, bytes: 28933, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2129416193303068834_1125, duration: 900340
2013-10-31 20:34:32,011 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2129416193303068834_1125 terminating
2013-10-31 20:34:32,012 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44513, dest: /127.0.0.1:33202, bytes: 28933, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2129416193303068834_1125, duration: 2547447
2013-10-31 20:34:32,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2129416193303068834_1125 terminating
2013-10-31 20:34:32,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40220, dest: /127.0.0.1:46399, bytes: 28933, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2129416193303068834_1125, duration: 4334564
2013-10-31 20:34:32,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2129416193303068834_1125 terminating
2013-10-31 20:34:32,018 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_2129416193303068834_1125 size 28933
2013-10-31 20:34:32,018 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml from client DFSClient_848976415
2013-10-31 20:34:32,018 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml is closed by DFSClient_848976415
2013-10-31 20:34:32,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2129416193303068834_1125 size 28933
2013-10-31 20:34:32,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2129416193303068834_1125 size 28933
2013-10-31 20:34:32,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml dst=null perm=null
2013-10-31 20:34:32,033 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34734, bytes: 29161, op: HDFS_READ, cliID: DFSClient_1298273249, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_2129416193303068834_1125, duration: 386013
2013-10-31 20:34:32,053 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0014: nMaps=1 nReduces=1 max=-1
2013-10-31 20:34:32,053 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0014 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:34:32,054 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0014
2013-10-31 20:34:32,054 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0014 RESULT=SUCCESS
2013-10-31 20:34:32,054 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0014
2013-10-31 20:34:32,056 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0014
2013-10-31 20:34:32,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_1383251672023_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F5F4FCFE94C6E4089 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:32,258 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_6920487667347938972_1001
2013-10-31 20:34:32,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:32,380 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_conf.xml. blk_35203064267953748_1127
2013-10-31 20:34:32,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_35203064267953748_1127 src: /127.0.0.1:44517 dest: /127.0.0.1:33202
2013-10-31 20:34:32,384 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_35203064267953748_1127 src: /127.0.0.1:34736 dest: /127.0.0.1:37249
2013-10-31 20:34:32,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_35203064267953748_1127 src: /127.0.0.1:36133 dest: /127.0.0.1:49827
2013-10-31 20:34:32,391 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36133, dest: /127.0.0.1:49827, bytes: 28998, op: HDFS_WRITE, cliID: DFSClient_1298273249, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_35203064267953748_1127, duration: 1689449
2013-10-31 20:34:32,391 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_35203064267953748_1127 terminating
2013-10-31 20:34:32,392 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_35203064267953748_1127 size 28998
2013-10-31 20:34:32,392 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34736, dest: /127.0.0.1:37249, bytes: 28998, op: HDFS_WRITE, cliID: DFSClient_1298273249, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_35203064267953748_1127, duration: 3467139
2013-10-31 20:34:32,393 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_35203064267953748_1127 terminating
2013-10-31 20:34:32,394 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44517, dest: /127.0.0.1:33202, bytes: 28998, op: HDFS_WRITE, cliID: DFSClient_1298273249, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_35203064267953748_1127, duration: 5410408
2013-10-31 20:34:32,395 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_35203064267953748_1127 size 28998
2013-10-31 20:34:32,395 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_35203064267953748_1127 terminating
2013-10-31 20:34:32,397 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_35203064267953748_1127 size 28998
2013-10-31 20:34:32,397 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_conf.xml from client DFSClient_1298273249
2013-10-31 20:34:32,398 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_conf.xml is closed by DFSClient_1298273249
2013-10-31 20:34:32,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:32,412 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014/jobToken. blk_-2379598675974902431_1128
2013-10-31 20:34:32,413 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2379598675974902431_1128 src: /127.0.0.1:34738 dest: /127.0.0.1:37249
2013-10-31 20:34:32,415 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2379598675974902431_1128 src: /127.0.0.1:40229 dest: /127.0.0.1:46399
2013-10-31 20:34:32,417 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2379598675974902431_1128 src: /127.0.0.1:36136 dest: /127.0.0.1:49827
2013-10-31 20:34:32,422 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36136, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2379598675974902431_1128, duration: 2335496
2013-10-31 20:34:32,422 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2379598675974902431_1128 terminating
2013-10-31 20:34:32,423 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-2379598675974902431_1128 size 116
2013-10-31 20:34:32,423 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40229, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2379598675974902431_1128, duration: 3201092
2013-10-31 20:34:32,423 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2379598675974902431_1128 terminating
2013-10-31 20:34:32,424 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34738, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2379598675974902431_1128, duration: 4052757
2013-10-31 20:34:32,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2379598675974902431_1128 terminating
2013-10-31 20:34:32,427 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-2379598675974902431_1128 size 116
2013-10-31 20:34:32,428 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014/jobToken from client DFSClient_848976415
2013-10-31 20:34:32,428 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014/jobToken is closed by DFSClient_848976415
2013-10-31 20:34:32,428 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-2379598675974902431_1128 size 116
2013-10-31 20:34:32,432 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014/jobToken
2013-10-31 20:34:32,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.splitmetainfo dst=null perm=null
2013-10-31 20:34:32,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36137, bytes: 49, op: HDFS_READ, cliID: DFSClient_1298273249, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8033824461140168631_1124, duration: 281174
2013-10-31 20:34:32,437 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0014 = 708. Number of splits = 1
2013-10-31 20:34:32,438 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:32,438 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:32,438 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:34:32,438 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0014 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:34:32,439 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0014 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:34:32,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7287552299518507654_1113 file build/test/data/dfs/data/data1/current/blk_-7287552299518507654 for deletion
2013-10-31 20:34:32,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4314432740026244915_1116 file build/test/data/dfs/data/data2/current/blk_-4314432740026244915 for deletion
2013-10-31 20:34:32,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7287552299518507654_1113 at file build/test/data/dfs/data/data1/current/blk_-7287552299518507654
2013-10-31 20:34:32,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2787968433030578623_1115 file build/test/data/dfs/data/data1/current/blk_2787968433030578623 for deletion
2013-10-31 20:34:32,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4314432740026244915_1116 at file build/test/data/dfs/data/data2/current/blk_-4314432740026244915
2013-10-31 20:34:32,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6170874266049809539_1114 file build/test/data/dfs/data/data2/current/blk_6170874266049809539 for deletion
2013-10-31 20:34:32,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2787968433030578623_1115 at file build/test/data/dfs/data/data1/current/blk_2787968433030578623
2013-10-31 20:34:32,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6170874266049809539_1114 at file build/test/data/dfs/data/data2/current/blk_6170874266049809539
2013-10-31 20:34:32,999 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0014_m_000002_0' to tip task_20131031202710049_0014_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:34:33,004 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0013_m_000001_0'
2013-10-31 20:34:33,007 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0014_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:34:33,007 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0014_m_000002_0 which needs 1 slots
2013-10-31 20:34:33,007 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0014_m_000002_0 which needs 1 slots
2013-10-31 20:34:33,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014/jobToken dst=null perm=null
2013-10-31 20:34:33,016 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40232, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2379598675974902431_1128, duration: 264897
2013-10-31 20:34:33,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.xml dst=null perm=null
2013-10-31 20:34:33,027 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44526, bytes: 29161, op: HDFS_READ, cliID: DFSClient_827086295, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2129416193303068834_1125, duration: 466225
2013-10-31 20:34:33,059 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:34:33,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.jar dst=null perm=null
2013-10-31 20:34:33,090 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36141, bytes: 239915, op: HDFS_READ, cliID: DFSClient_827086295, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7823287138518006582_1122, duration: 1429065
2013-10-31 20:34:33,200 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0014_m_-196111591
2013-10-31 20:34:33,201 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0014_m_-196111591 spawned.
2013-10-31 20:34:33,203 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0014/attempt_20131031202710049_0014_m_000002_0/taskjvm.sh
2013-10-31 20:34:33,318 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0013
2013-10-31 20:34:33,319 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0013 being deleted.
2013-10-31 20:34:33,583 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0013
2013-10-31 20:34:33,583 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0013 being deleted.
2013-10-31 20:34:34,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7287552299518507654_1113 file build/test/data/dfs/data/data7/current/blk_-7287552299518507654 for deletion
2013-10-31 20:34:34,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4314432740026244915_1116 file build/test/data/dfs/data/data8/current/blk_-4314432740026244915 for deletion
2013-10-31 20:34:34,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2787968433030578623_1115 file build/test/data/dfs/data/data7/current/blk_2787968433030578623 for deletion
2013-10-31 20:34:34,153 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6170874266049809539_1114 file build/test/data/dfs/data/data8/current/blk_6170874266049809539 for deletion
2013-10-31 20:34:34,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4314432740026244915_1116 at file build/test/data/dfs/data/data8/current/blk_-4314432740026244915
2013-10-31 20:34:34,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7287552299518507654_1113 at file build/test/data/dfs/data/data7/current/blk_-7287552299518507654
2013-10-31 20:34:34,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6170874266049809539_1114 at file build/test/data/dfs/data/data8/current/blk_6170874266049809539
2013-10-31 20:34:34,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2787968433030578623_1115 at file build/test/data/dfs/data/data7/current/blk_2787968433030578623
2013-10-31 20:34:34,469 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:49827 to replicate blk_7823287138518006582_1122 to datanode(s) 127.0.0.1:33202
2013-10-31 20:34:34,469 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-1291096700449495548_1119
2013-10-31 20:34:34,469 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-1291096700449495548_1119
2013-10-31 20:34:34,989 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0014_m_-196111591 given task: attempt_20131031202710049_0014_m_000002_0
2013-10-31 20:34:35,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:35,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1291096700449495548_1119 file build/test/data/dfs/data/data2/current/blk_-1291096700449495548 for deletion
2013-10-31 20:34:35,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1291096700449495548_1119 at file build/test/data/dfs/data/data2/current/blk_-1291096700449495548
2013-10-31 20:34:36,327 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1291096700449495548_1119 file build/test/data/dfs/data/data4/current/blk_-1291096700449495548 for deletion
2013-10-31 20:34:36,327 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1291096700449495548_1119 at file build/test/data/dfs/data/data4/current/blk_-1291096700449495548
2013-10-31 20:34:36,746 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0013
2013-10-31 20:34:36,747 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0013_m_000002_0 not found in cache
2013-10-31 20:34:36,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0013 for user-log deletion with retainTimeStamp:1383338076748
2013-10-31 20:34:37,016 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0013_r_-218308890 since job job_20131031202710049_0013 is dead
2013-10-31 20:34:37,027 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31844 with signal TERM. Exit code 0
2013-10-31 20:34:37,153 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207) Starting thread to transfer block blk_7823287138518006582_1122 to 127.0.0.1:33202
2013-10-31 20:34:37,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7823287138518006582_1122 src: /127.0.0.1:44533 dest: /127.0.0.1:33202
2013-10-31 20:34:37,154 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207):Transmitted block blk_7823287138518006582_1122 to /127.0.0.1:33202
2013-10-31 20:34:37,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7823287138518006582_1122 src: /127.0.0.1:44533 dest: /127.0.0.1:33202 of size 238055
2013-10-31 20:34:37,158 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7823287138518006582_1122 size 238055
2013-10-31 20:34:37,207 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:37,207 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:37,207 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:37,207 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0013_r_-218308890 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:34:37,336 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0013_m_-1411194620 since job job_20131031202710049_0013 is dead
2013-10-31 20:34:37,346 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31706 with signal TERM. Exit code 0
2013-10-31 20:34:37,470 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-1291096700449495548_1119
2013-10-31 20:34:37,563 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:37,564 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:37,564 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:37,564 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0013_m_-1411194620 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:34:37,785 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0013_m_-1080452451 since job job_20131031202710049_0013 is dead
2013-10-31 20:34:37,795 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31599 with signal TERM. Exit code 0
2013-10-31 20:34:37,990 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:37,990 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:37,990 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:37,990 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0013_m_-1080452451 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:34:38,007 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0013
2013-10-31 20:34:38,008 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0013 for user-log deletion with retainTimeStamp:1383338078008
2013-10-31 20:34:38,412 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_m_000002_0 0.0% setup
2013-10-31 20:34:38,415 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0014_m_000002_0 is done.
2013-10-31 20:34:38,415 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0014_m_000002_0 was -1
2013-10-31 20:34:38,415 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:38,727 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0013_m_917077929 since job job_20131031202710049_0013 is dead
2013-10-31 20:34:38,737 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31765 with signal TERM. Exit code 0
2013-10-31 20:34:38,939 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:34:38,939 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:34:38,939 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:34:38,939 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0013_m_917077929 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:34:39,012 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0014_m_000002_0' has completed task_20131031202710049_0014_m_000002 successfully.
2013-10-31 20:34:39,015 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0014_m_000000_0' to tip task_20131031202710049_0014_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:34:39,017 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0014_m_000000
2013-10-31 20:34:39,018 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0014_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:34:39,019 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0014_m_000000_0 which needs 1 slots
2013-10-31 20:34:39,019 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0014_m_000000_0 which needs 1 slots
2013-10-31 20:34:39,058 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0014_m_1629363979
2013-10-31 20:34:39,059 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0014_m_1629363979 spawned.
2013-10-31 20:34:39,062 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0014/attempt_20131031202710049_0014_m_000000_0/taskjvm.sh
2013-10-31 20:34:39,772 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1291096700449495548_1119 file build/test/data/dfs/data/data6/current/blk_-1291096700449495548 for deletion
2013-10-31 20:34:39,773 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1291096700449495548_1119 at file build/test/data/dfs/data/data6/current/blk_-1291096700449495548
2013-10-31 20:34:39,890 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0014_m_1629363979 given task: attempt_20131031202710049_0014_m_000000_0
2013-10-31 20:34:40,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014/job.split dst=null perm=null
2013-10-31 20:34:40,378 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34754, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0014_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8792267483495418095_1123, duration: 265273
2013-10-31 20:34:40,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/part-00000 dst=null perm=null
2013-10-31 20:34:40,417 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44537, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0014_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4718961324494384221_1120, duration: 328193
2013-10-31 20:34:43,309 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854/part-00000:0+708
2013-10-31 20:34:43,314 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0014_m_000000_0 is done.
2013-10-31 20:34:43,314 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0014_m_000000_0 was 619
2013-10-31 20:34:43,314 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:44,019 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0014_m_000002_0
2013-10-31 20:34:44,019 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0014_m_000002_0
2013-10-31 20:34:44,020 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0014_m_000002_0 not found in cache
2013-10-31 20:34:45,027 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0014_m_000000_0' has completed task_20131031202710049_0014_m_000000 successfully.
2013-10-31 20:34:45,029 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0014_r_000000_0' to tip task_20131031202710049_0014_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:34:45,031 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0014_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:34:45,031 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0014_r_000000_0 which needs 1 slots
2013-10-31 20:34:45,032 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0014_r_000000_0 which needs 1 slots
2013-10-31 20:34:45,064 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0014_r_1263659617
2013-10-31 20:34:45,064 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0014_r_1263659617 spawned.
2013-10-31 20:34:45,066 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0014/attempt_20131031202710049_0014_r_000000_0/taskjvm.sh
2013-10-31 20:34:46,088 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0014_r_1263659617 given task: attempt_20131031202710049_0014_r_000000_0
2013-10-31 20:34:50,002 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 42
2013-10-31 20:34:51,798 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53798, bytes: 619, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0014_m_000000_0, duration: 6106719
2013-10-31 20:34:52,588 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:34:52,663 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:34:52,734 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:34:52,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:52,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:52,942 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0/part-00000. blk_-1490366267987572303_1129
2013-10-31 20:34:52,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1490366267987572303_1129 src: /127.0.0.1:40249 dest: /127.0.0.1:46399
2013-10-31 20:34:52,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1490366267987572303_1129 src: /127.0.0.1:34760 dest: /127.0.0.1:37249
2013-10-31 20:34:52,987 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1490366267987572303_1129 src: /127.0.0.1:44543 dest: /127.0.0.1:33202
2013-10-31 20:34:52,990 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44543, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0014_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1490366267987572303_1129, duration: 1835347
2013-10-31 20:34:52,991 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1490366267987572303_1129 terminating
2013-10-31 20:34:52,991 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34760, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0014_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1490366267987572303_1129, duration: 1633031
2013-10-31 20:34:52,991 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1490366267987572303_1129 terminating
2013-10-31 20:34:52,992 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40249, dest: /127.0.0.1:46399, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0014_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1490366267987572303_1129, duration: 2088946
2013-10-31 20:34:52,992 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1490366267987572303_1129 size 708
2013-10-31 20:34:52,992 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1490366267987572303_1129 terminating
2013-10-31 20:34:52,996 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0014_r_000000_0
2013-10-31 20:34:52,996 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0014_r_000000_0
2013-10-31 20:34:52,996 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1490366267987572303_1129 size 708
2013-10-31 20:34:52,996 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1490366267987572303_1129 size 708
2013-10-31 20:34:53,036 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0014_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:34:53,036 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:34:54,041 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0014_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:34:54,042 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0014_r_000000_0
2013-10-31 20:34:55,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0 dst=null perm=null
2013-10-31 20:34:55,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:34:55,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:55,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary/_attempt_20131031202710049_0014_r_000000_0 dst=null perm=null
2013-10-31 20:34:55,647 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_r_000000_0 1.0% reduce > reduce
2013-10-31 20:34:55,651 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_r_000000_0 1.0% reduce > reduce
2013-10-31 20:34:55,652 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0014_r_000000_0 is done.
2013-10-31 20:34:55,652 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0014_r_000000_0 was -1
2013-10-31 20:34:55,652 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:34:57,045 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0014_r_000000_0' has completed task_20131031202710049_0014_r_000000 successfully.
2013-10-31 20:34:57,049 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0014_m_000001_0' to tip task_20131031202710049_0014_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:34:57,051 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0014_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:34:57,052 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0014_m_000001_0 which needs 1 slots
2013-10-31 20:34:57,052 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0014_m_000001_0 which needs 1 slots
2013-10-31 20:34:57,084 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0014/attempt_20131031202710049_0014_m_000001_0. Attempting to reuse: jvm_20131031202710049_0014_m_1629363979
2013-10-31 20:34:57,381 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0014_m_1629363979 given task: attempt_20131031202710049_0014_m_000001_0
2013-10-31 20:34:57,516 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_m_000001_0 0.0%
2013-10-31 20:34:57,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary dst=null perm=null
2013-10-31 20:34:57,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:34:57,532 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_SUCCESS from client DFSClient_attempt_20131031202710049_0014_m_000001_0
2013-10-31 20:34:57,532 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0014_m_000001_0
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7823287138518006582 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7823287138518006582 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7823287138518006582 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7823287138518006582 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8792267483495418095 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8792267483495418095 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8792267483495418095 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8792267483495418095 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8033824461140168631 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8033824461140168631 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:57,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8033824461140168631 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:34:57,537 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2129416193303068834 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:34:57,537 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2129416193303068834 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:34:57,537 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2129416193303068834 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:34:57,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0014 dst=null perm=null
2013-10-31 20:34:58,473 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-8033824461140168631_1124 blk_7823287138518006582_1122 blk_-8792267483495418095_1123 blk_2129416193303068834_1125
2013-10-31 20:34:58,473 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-8033824461140168631_1124 blk_7823287138518006582_1122 blk_-8792267483495418095_1123
2013-10-31 20:35:00,467 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0014_m_000001_0 0.0% cleanup
2013-10-31 20:35:00,469 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0014_m_000001_0 is done.
2013-10-31 20:35:00,469 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0014_m_000001_0 was -1
2013-10-31 20:35:00,470 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:00,779 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8792267483495418095_1123 file build/test/data/dfs/data/data5/current/blk_-8792267483495418095 for deletion
2013-10-31 20:35:00,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8033824461140168631_1124 file build/test/data/dfs/data/data6/current/blk_-8033824461140168631 for deletion
2013-10-31 20:35:00,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8792267483495418095_1123 at file build/test/data/dfs/data/data5/current/blk_-8792267483495418095
2013-10-31 20:35:00,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2129416193303068834_1125 file build/test/data/dfs/data/data5/current/blk_2129416193303068834 for deletion
2013-10-31 20:35:00,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8033824461140168631_1124 at file build/test/data/dfs/data/data6/current/blk_-8033824461140168631
2013-10-31 20:35:00,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7823287138518006582_1122 file build/test/data/dfs/data/data6/current/blk_7823287138518006582 for deletion
2013-10-31 20:35:00,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2129416193303068834_1125 at file build/test/data/dfs/data/data5/current/blk_2129416193303068834
2013-10-31 20:35:00,781 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7823287138518006582_1122 at file build/test/data/dfs/data/data6/current/blk_7823287138518006582
2013-10-31 20:35:01,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8792267483495418095_1123 file build/test/data/dfs/data/data7/current/blk_-8792267483495418095 for deletion
2013-10-31 20:35:01,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8033824461140168631_1124 file build/test/data/dfs/data/data8/current/blk_-8033824461140168631 for deletion
2013-10-31 20:35:01,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8792267483495418095_1123 at file build/test/data/dfs/data/data7/current/blk_-8792267483495418095
2013-10-31 20:35:01,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8033824461140168631_1124 at file build/test/data/dfs/data/data8/current/blk_-8033824461140168631
2013-10-31 20:35:01,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7823287138518006582_1122 file build/test/data/dfs/data/data8/current/blk_7823287138518006582 for deletion
2013-10-31 20:35:01,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7823287138518006582_1122 at file build/test/data/dfs/data/data8/current/blk_7823287138518006582
2013-10-31 20:35:01,474 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-8033824461140168631_1124 blk_7823287138518006582_1122 blk_-8792267483495418095_1123 blk_2129416193303068834_1125
2013-10-31 20:35:01,474 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_7823287138518006582_1122 blk_-8792267483495418095_1123 blk_2129416193303068834_1125
2013-10-31 20:35:02,052 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0014_r_000000_0
2013-10-31 20:35:02,052 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0014_r_000000_0
2013-10-31 20:35:02,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8792267483495418095_1123 file build/test/data/dfs/data/data2/current/blk_-8792267483495418095 for deletion
2013-10-31 20:35:02,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2129416193303068834_1125 file build/test/data/dfs/data/data1/current/blk_2129416193303068834 for deletion
2013-10-31 20:35:02,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8792267483495418095_1123 at file build/test/data/dfs/data/data2/current/blk_-8792267483495418095
2013-10-31 20:35:02,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7823287138518006582_1122 file build/test/data/dfs/data/data1/current/blk_7823287138518006582 for deletion
2013-10-31 20:35:02,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2129416193303068834_1125 at file build/test/data/dfs/data/data1/current/blk_2129416193303068834
2013-10-31 20:35:02,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7823287138518006582_1122 at file build/test/data/dfs/data/data1/current/blk_7823287138518006582
2013-10-31 20:35:03,058 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0014_m_000001_0' has completed task_20131031202710049_0014_m_000001 successfully.
2013-10-31 20:35:03,059 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0014 has completed successfully.
2013-10-31 20:35:03,059 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0014,submitTime=1383251672023,launchTime=1383251672439,firstMapTaskLaunchTime=1383251679015,firstReduceTaskLaunchTime=1383251685029,firstJobSetupTaskLaunchTime=1383251672999,firstJobCleanupTaskLaunchTime=1383251697049,finishTime=1383251703059,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[20CC04FCE8284B1BB74FAE59442CCC95/5F4FCFE94C6E4089BBE0352E46D7A7B0] lower*upper/(2/2) ...e/false/false/false/false
2013-10-31 20:35:03,065 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_1383251672023_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F5F4FCFE94C6E4089. blk_8667774120618533807_1130
2013-10-31 20:35:03,069 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8667774120618533807_1130 src: /127.0.0.1:36162 dest: /127.0.0.1:49827
2013-10-31 20:35:03,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8667774120618533807_1130 src: /127.0.0.1:44549 dest: /127.0.0.1:33202
2013-10-31 20:35:03,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8667774120618533807_1130 src: /127.0.0.1:34768 dest: /127.0.0.1:37249
2013-10-31 20:35:03,082 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34768, dest: /127.0.0.1:37249, bytes: 16919, op: HDFS_WRITE, cliID: DFSClient_1298273249, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8667774120618533807_1130, duration: 5575843
2013-10-31 20:35:03,083 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8667774120618533807_1130 terminating
2013-10-31 20:35:03,084 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44549, dest: /127.0.0.1:33202, bytes: 16919, op: HDFS_WRITE, cliID: DFSClient_1298273249, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8667774120618533807_1130, duration: 5703303
2013-10-31 20:35:03,084 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8667774120618533807_1130 terminating
2013-10-31 20:35:03,085 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36162, dest: /127.0.0.1:49827, bytes: 16919, op: HDFS_WRITE, cliID: DFSClient_1298273249, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8667774120618533807_1130, duration: 9223420
2013-10-31 20:35:03,086 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8667774120618533807_1130 terminating
2013-10-31 20:35:03,089 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8667774120618533807_1130 size 16919
2013-10-31 20:35:03,089 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_1383251672023_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F5F4FCFE94C6E4089 from client DFSClient_1298273249
2013-10-31 20:35:03,089 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_logs/history/job_20131031202710049_0014_1383251672023_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F5F4FCFE94C6E4089 is closed by DFSClient_1298273249
2013-10-31 20:35:03,090 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8667774120618533807_1130 size 16919
2013-10-31 20:35:03,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8667774120618533807_1130 size 16919
2013-10-31 20:35:03,097 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0014_1383251672023_hadoop_%5B20CC04FCE8284B1BB74FAE59442CCC95%2F5F4FCFE94C6E4089 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:35:03,098 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0014_m_000000_0'
2013-10-31 20:35:03,098 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0014_m_000001_0'
2013-10-31 20:35:03,098 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0014_m_000002_0'
2013-10-31 20:35:03,098 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0014_r_000000_0'
2013-10-31 20:35:03,099 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2379598675974902431 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:03,100 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2379598675974902431 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:03,100 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2379598675974902431 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:03,107 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7410404075519366896 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:35:03,107 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7410404075519366896 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:03,107 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7410404075519366896 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:03,107 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8594137634848644750 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:03,108 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8594137634848644750 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:03,108 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8594137634848644750 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:03,108 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4718961324494384221 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:03,108 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4718961324494384221 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:03,109 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4718961324494384221 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:35:03,111 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0014_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:35:03,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0014 dst=null perm=null
2013-10-31 20:35:03,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5043857522_lower_upper_C73AE8BD81BC4852AE42593380BF3854 dst=null perm=null
2013-10-31 20:35:03,218 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/_temporary
2013-10-31 20:35:03,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false dst=null perm=null
2013-10-31 20:35:03,238 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:35:03,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:35:03,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:35:03,241 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34770, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1490366267987572303_1129, duration: 932083
2013-10-31 20:35:03,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false dst=null perm=null
2013-10-31 20:35:03,249 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:35:03,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:35:03,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:35:03,251 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44553, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1490366267987572303_1129, duration: 153492
2013-10-31 20:35:03,252 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false
2013-10-31 20:35:03,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false dst=null perm=null
2013-10-31 20:35:03,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/false/false/false/false/part-00000 dst=null perm=null
2013-10-31 20:35:03,256 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44554, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1490366267987572303_1129, duration: 156938
2013-10-31 20:35:03,265 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:35:03,265 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:35:03,287 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:35:03,287 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:35:03,287 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:35:03,287 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false"]
2013-10-31 20:35:03,288 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:35:03,288 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:35:03,288 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:35:03,289 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:35:03,293 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:35:03,293 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:35:03,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:03,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:35:03,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,309 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar. blk_6440951044851290042_1131
2013-10-31 20:35:03,310 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6440951044851290042_1131 src: /127.0.0.1:34773 dest: /127.0.0.1:37249
2013-10-31 20:35:03,311 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6440951044851290042_1131 src: /127.0.0.1:40264 dest: /127.0.0.1:46399
2013-10-31 20:35:03,311 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6440951044851290042_1131 src: /127.0.0.1:44557 dest: /127.0.0.1:33202
2013-10-31 20:35:03,315 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44557, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6440951044851290042_1131, duration: 2147579
2013-10-31 20:35:03,316 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6440951044851290042_1131 terminating
2013-10-31 20:35:03,316 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40264, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6440951044851290042_1131, duration: 3115962
2013-10-31 20:35:03,316 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6440951044851290042_1131 terminating
2013-10-31 20:35:03,317 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34773, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6440951044851290042_1131, duration: 3983008
2013-10-31 20:35:03,317 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6440951044851290042_1131 terminating
2013-10-31 20:35:03,319 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_6440951044851290042_1131 size 238055
2013-10-31 20:35:03,320 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6440951044851290042_1131 size 238055
2013-10-31 20:35:03,320 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar from client DFSClient_848976415
2013-10-31 20:35:03,320 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar is closed by DFSClient_848976415
2013-10-31 20:35:03,321 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6440951044851290042_1131 size 238055
2013-10-31 20:35:03,324 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar. New replication is 10
2013-10-31 20:35:03,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar dst=null perm=null
2013-10-31 20:35:03,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8792267483495418095_1123 file build/test/data/dfs/data/data3/current/blk_-8792267483495418095 for deletion
2013-10-31 20:35:03,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8033824461140168631_1124 file build/test/data/dfs/data/data4/current/blk_-8033824461140168631 for deletion
2013-10-31 20:35:03,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8792267483495418095_1123 at file build/test/data/dfs/data/data3/current/blk_-8792267483495418095
2013-10-31 20:35:03,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2129416193303068834_1125 file build/test/data/dfs/data/data3/current/blk_2129416193303068834 for deletion
2013-10-31 20:35:03,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8033824461140168631_1124 at file build/test/data/dfs/data/data4/current/blk_-8033824461140168631
2013-10-31 20:35:03,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7823287138518006582_1122 file build/test/data/dfs/data/data3/current/blk_7823287138518006582 for deletion
2013-10-31 20:35:03,336 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2129416193303068834_1125 at file build/test/data/dfs/data/data3/current/blk_2129416193303068834
2013-10-31 20:35:03,336 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7823287138518006582_1122 at file build/test/data/dfs/data/data3/current/blk_7823287138518006582
2013-10-31 20:35:03,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,337 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:35:03,340 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:35:03,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:35:03,342 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:35:03,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:35:03,349 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0014
2013-10-31 20:35:03,349 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0014 being deleted.
2013-10-31 20:35:03,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,357 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split. New replication is 10
2013-10-31 20:35:03,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split dst=null perm=null
2013-10-31 20:35:03,362 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split. blk_-7982900489810622284_1132
2013-10-31 20:35:03,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982900489810622284_1132 src: /127.0.0.1:44558 dest: /127.0.0.1:33202
2013-10-31 20:35:03,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982900489810622284_1132 src: /127.0.0.1:36173 dest: /127.0.0.1:49827
2013-10-31 20:35:03,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982900489810622284_1132 src: /127.0.0.1:40268 dest: /127.0.0.1:46399
2013-10-31 20:35:03,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7982900489810622284_1132 src: /127.0.0.1:34779 dest: /127.0.0.1:37249
2013-10-31 20:35:03,370 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34779, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7982900489810622284_1132, duration: 1443190
2013-10-31 20:35:03,370 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7982900489810622284_1132 terminating
2013-10-31 20:35:03,370 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7982900489810622284_1132 size 697
2013-10-31 20:35:03,371 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40268, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7982900489810622284_1132, duration: 1238685
2013-10-31 20:35:03,371 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7982900489810622284_1132 terminating
2013-10-31 20:35:03,372 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36173, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7982900489810622284_1132, duration: 2167513
2013-10-31 20:35:03,373 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7982900489810622284_1132 terminating
2013-10-31 20:35:03,373 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44558, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7982900489810622284_1132, duration: 3847900
2013-10-31 20:35:03,374 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7982900489810622284_1132 terminating
2013-10-31 20:35:03,375 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7982900489810622284_1132 size 697
2013-10-31 20:35:03,375 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split from client DFSClient_848976415
2013-10-31 20:35:03,375 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split is closed by DFSClient_848976415
2013-10-31 20:35:03,376 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7982900489810622284_1132 size 697
2013-10-31 20:35:03,377 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7982900489810622284_1132 size 697
2013-10-31 20:35:03,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,393 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.splitmetainfo. blk_3568828130362572904_1133
2013-10-31 20:35:03,394 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3568828130362572904_1133 src: /127.0.0.1:34780 dest: /127.0.0.1:37249
2013-10-31 20:35:03,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3568828130362572904_1133 src: /127.0.0.1:44563 dest: /127.0.0.1:33202
2013-10-31 20:35:03,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3568828130362572904_1133 src: /127.0.0.1:40272 dest: /127.0.0.1:46399
2013-10-31 20:35:03,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40272, dest: /127.0.0.1:46399, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3568828130362572904_1133, duration: 1074503
2013-10-31 20:35:03,403 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3568828130362572904_1133 size 78
2013-10-31 20:35:03,404 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3568828130362572904_1133 terminating
2013-10-31 20:35:03,405 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44563, dest: /127.0.0.1:33202, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3568828130362572904_1133, duration: 6516103
2013-10-31 20:35:03,405 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3568828130362572904_1133 terminating
2013-10-31 20:35:03,406 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34780, dest: /127.0.0.1:37249, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3568828130362572904_1133, duration: 7723031
2013-10-31 20:35:03,407 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3568828130362572904_1133 terminating
2013-10-31 20:35:03,408 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:35:03,408 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:35:03,408 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3568828130362572904_1133 size 78
2013-10-31 20:35:03,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3568828130362572904_1133 size 78
2013-10-31 20:35:03,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,427 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml. blk_-8954546216927232859_1134
2013-10-31 20:35:03,428 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8954546216927232859_1134 src: /127.0.0.1:44565 dest: /127.0.0.1:33202
2013-10-31 20:35:03,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8954546216927232859_1134 src: /127.0.0.1:40274 dest: /127.0.0.1:46399
2013-10-31 20:35:03,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8954546216927232859_1134 src: /127.0.0.1:36181 dest: /127.0.0.1:49827
2013-10-31 20:35:03,433 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36181, dest: /127.0.0.1:49827, bytes: 29349, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8954546216927232859_1134, duration: 1888854
2013-10-31 20:35:03,433 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8954546216927232859_1134 terminating
2013-10-31 20:35:03,434 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40274, dest: /127.0.0.1:46399, bytes: 29349, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8954546216927232859_1134, duration: 2283190
2013-10-31 20:35:03,434 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8954546216927232859_1134 terminating
2013-10-31 20:35:03,435 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44565, dest: /127.0.0.1:33202, bytes: 29349, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8954546216927232859_1134, duration: 3382118
2013-10-31 20:35:03,435 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8954546216927232859_1134 size 29349
2013-10-31 20:35:03,436 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8954546216927232859_1134 terminating
2013-10-31 20:35:03,437 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-8954546216927232859_1134 size 29349
2013-10-31 20:35:03,437 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml from client DFSClient_848976415
2013-10-31 20:35:03,437 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml is closed by DFSClient_848976415
2013-10-31 20:35:03,438 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8954546216927232859_1134 size 29349
2013-10-31 20:35:03,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml dst=null perm=null
2013-10-31 20:35:03,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44569, bytes: 29581, op: HDFS_READ, cliID: DFSClient_930556513, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8954546216927232859_1134, duration: 161313
2013-10-31 20:35:03,460 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0015: nMaps=2 nReduces=1 max=-1
2013-10-31 20:35:03,460 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0015 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:35:03,460 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0015
2013-10-31 20:35:03,460 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0015
2013-10-31 20:35:03,460 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0015 RESULT=SUCCESS
2013-10-31 20:35:03,461 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0015
2013-10-31 20:35:03,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_1383251703441_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F790E78452B2F4BB4 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,614 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0014
2013-10-31 20:35:03,614 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0014 being deleted.
2013-10-31 20:35:03,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,770 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_conf.xml. blk_-6215904457775077827_1136
2013-10-31 20:35:03,772 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6215904457775077827_1136 src: /127.0.0.1:34788 dest: /127.0.0.1:37249
2013-10-31 20:35:03,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6215904457775077827_1136 src: /127.0.0.1:44571 dest: /127.0.0.1:33202
2013-10-31 20:35:03,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6215904457775077827_1136 src: /127.0.0.1:40280 dest: /127.0.0.1:46399
2013-10-31 20:35:03,781 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40280, dest: /127.0.0.1:46399, bytes: 29414, op: HDFS_WRITE, cliID: DFSClient_930556513, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6215904457775077827_1136, duration: 2045682
2013-10-31 20:35:03,782 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6215904457775077827_1136 terminating
2013-10-31 20:35:03,783 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44571, dest: /127.0.0.1:33202, bytes: 29414, op: HDFS_WRITE, cliID: DFSClient_930556513, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6215904457775077827_1136, duration: 2848773
2013-10-31 20:35:03,783 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-6215904457775077827_1136 size 29414
2013-10-31 20:35:03,783 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6215904457775077827_1136 terminating
2013-10-31 20:35:03,785 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34788, dest: /127.0.0.1:37249, bytes: 29414, op: HDFS_WRITE, cliID: DFSClient_930556513, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6215904457775077827_1136, duration: 5331343
2013-10-31 20:35:03,785 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6215904457775077827_1136 terminating
2013-10-31 20:35:03,787 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-6215904457775077827_1136 size 29414
2013-10-31 20:35:03,787 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_conf.xml from client DFSClient_930556513
2013-10-31 20:35:03,788 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_conf.xml is closed by DFSClient_930556513
2013-10-31 20:35:03,789 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-6215904457775077827_1136 size 29414
2013-10-31 20:35:03,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:03,800 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken. blk_-4230247361908926647_1137
2013-10-31 20:35:03,802 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230247361908926647_1137 src: /127.0.0.1:40281 dest: /127.0.0.1:46399
2013-10-31 20:35:03,803 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230247361908926647_1137 src: /127.0.0.1:34792 dest: /127.0.0.1:37249
2013-10-31 20:35:03,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230247361908926647_1137 src: /127.0.0.1:36189 dest: /127.0.0.1:49827
2013-10-31 20:35:03,813 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36189, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4230247361908926647_1137, duration: 2269541
2013-10-31 20:35:03,813 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4230247361908926647_1137 terminating
2013-10-31 20:35:03,813 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34792, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4230247361908926647_1137, duration: 2956304
2013-10-31 20:35:03,814 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4230247361908926647_1137 terminating
2013-10-31 20:35:03,814 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40281, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4230247361908926647_1137, duration: 3934634
2013-10-31 20:35:03,815 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4230247361908926647_1137 terminating
2013-10-31 20:35:03,819 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4230247361908926647_1137 size 116
2013-10-31 20:35:03,819 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken from client DFSClient_848976415
2013-10-31 20:35:03,820 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken is closed by DFSClient_848976415
2013-10-31 20:35:03,820 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4230247361908926647_1137 size 116
2013-10-31 20:35:03,820 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4230247361908926647_1137 size 116
2013-10-31 20:35:03,824 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken
2013-10-31 20:35:03,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.splitmetainfo dst=null perm=null
2013-10-31 20:35:03,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40284, bytes: 82, op: HDFS_READ, cliID: DFSClient_930556513, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3568828130362572904_1133, duration: 270659
2013-10-31 20:35:03,829 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0015 = 38. Number of splits = 2
2013-10-31 20:35:03,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:03,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:03,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:03,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:03,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:03,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:03,831 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0015 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:35:03,831 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0015 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:35:04,475 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:46399 to replicate blk_6440951044851290042_1131 to datanode(s) 127.0.0.1:49827
2013-10-31 20:35:04,476 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_4718961324494384221_1120 blk_-8594137634848644750_1118 blk_-2379598675974902431_1128
2013-10-31 20:35:04,476 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-7410404075519366896_1121 blk_4718961324494384221_1120 blk_-8594137634848644750_1118 blk_-2379598675974902431_1128
2013-10-31 20:35:04,782 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0015_m_000003_0' to tip task_20131031202710049_0015_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:35:04,789 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0015_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:35:04,789 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0015_m_000003_0 which needs 1 slots
2013-10-31 20:35:04,789 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0014
2013-10-31 20:35:04,790 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0015_m_000003_0 which needs 1 slots
2013-10-31 20:35:04,790 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0014 being deleted.
2013-10-31 20:35:04,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken dst=null perm=null
2013-10-31 20:35:04,800 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34795, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4230247361908926647_1137, duration: 279938
2013-10-31 20:35:04,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml dst=null perm=null
2013-10-31 20:35:04,812 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44579, bytes: 29581, op: HDFS_READ, cliID: DFSClient_1131950728, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-8954546216927232859_1134, duration: 365221
2013-10-31 20:35:04,844 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:35:04,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar dst=null perm=null
2013-10-31 20:35:04,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40288, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1131950728, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_6440951044851290042_1131, duration: 1355145
2013-10-31 20:35:04,981 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0015_m_-945716405
2013-10-31 20:35:04,982 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0015_m_-945716405 spawned.
2013-10-31 20:35:04,983 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0015/attempt_20131031202710049_0015_m_000003_0/taskjvm.sh
2013-10-31 20:35:05,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8594137634848644750_1118 file build/test/data/dfs/data/data1/current/blk_-8594137634848644750 for deletion
2013-10-31 20:35:05,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2379598675974902431_1128 file build/test/data/dfs/data/data1/current/blk_-2379598675974902431 for deletion
2013-10-31 20:35:05,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8594137634848644750_1118 at file build/test/data/dfs/data/data1/current/blk_-8594137634848644750
2013-10-31 20:35:05,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4718961324494384221_1120 file build/test/data/dfs/data/data2/current/blk_4718961324494384221 for deletion
2013-10-31 20:35:05,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2379598675974902431_1128 at file build/test/data/dfs/data/data1/current/blk_-2379598675974902431
2013-10-31 20:35:05,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4718961324494384221_1120 at file build/test/data/dfs/data/data2/current/blk_4718961324494384221
2013-10-31 20:35:06,782 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272) Starting thread to transfer block blk_6440951044851290042_1131 to 127.0.0.1:49827
2013-10-31 20:35:06,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6440951044851290042_1131 src: /127.0.0.1:36195 dest: /127.0.0.1:49827
2013-10-31 20:35:06,783 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272):Transmitted block blk_6440951044851290042_1131 to /127.0.0.1:49827
2013-10-31 20:35:06,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6440951044851290042_1131 src: /127.0.0.1:36195 dest: /127.0.0.1:49827 of size 238055
2013-10-31 20:35:06,787 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6440951044851290042_1131 size 238055
2013-10-31 20:35:07,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8594137634848644750_1118 file build/test/data/dfs/data/data7/current/blk_-8594137634848644750 for deletion
2013-10-31 20:35:07,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7410404075519366896_1121 file build/test/data/dfs/data/data7/current/blk_-7410404075519366896 for deletion
2013-10-31 20:35:07,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8594137634848644750_1118 at file build/test/data/dfs/data/data7/current/blk_-8594137634848644750
2013-10-31 20:35:07,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2379598675974902431_1128 file build/test/data/dfs/data/data8/current/blk_-2379598675974902431 for deletion
2013-10-31 20:35:07,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7410404075519366896_1121 at file build/test/data/dfs/data/data7/current/blk_-7410404075519366896
2013-10-31 20:35:07,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4718961324494384221_1120 file build/test/data/dfs/data/data8/current/blk_4718961324494384221 for deletion
2013-10-31 20:35:07,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2379598675974902431_1128 at file build/test/data/dfs/data/data8/current/blk_-2379598675974902431
2013-10-31 20:35:07,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4718961324494384221_1120 at file build/test/data/dfs/data/data8/current/blk_4718961324494384221
2013-10-31 20:35:07,171 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0015_m_-945716405 given task: attempt_20131031202710049_0015_m_000003_0
2013-10-31 20:35:07,476 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-7410404075519366896_1121 blk_-8594137634848644750_1118 blk_-2379598675974902431_1128
2013-10-31 20:35:07,477 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-7410404075519366896_1121 blk_4718961324494384221_1120
2013-10-31 20:35:07,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:08,051 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:35:08,067 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:35:08,079 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:35:08,084 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:35:08,090 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:35:08,095 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:35:08,100 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0014
2013-10-31 20:35:08,100 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0014_m_000001_0 not found in cache
2013-10-31 20:35:08,101 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0014 for user-log deletion with retainTimeStamp:1383338108100
2013-10-31 20:35:08,101 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:35:08,101 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:35:08,186 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0014_r_1263659617 since job job_20131031202710049_0014 is dead
2013-10-31 20:35:08,196 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32225 with signal TERM. Exit code 0
2013-10-31 20:35:08,373 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:08,373 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:08,373 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:08,373 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0014_r_1263659617 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:35:08,502 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0014_m_1629363979 since job job_20131031202710049_0014 is dead
2013-10-31 20:35:08,514 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32155 with signal TERM. Exit code 0
2013-10-31 20:35:08,684 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:08,684 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:08,684 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:08,685 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0014_m_1629363979 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:35:09,080 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0014_m_-196111591 since job job_20131031202710049_0014 is dead
2013-10-31 20:35:09,089 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32033 with signal TERM. Exit code 0
2013-10-31 20:35:09,262 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:09,263 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:09,263 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:09,264 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0014_m_-196111591 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:35:09,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7410404075519366896_1121 file build/test/data/dfs/data/data4/current/blk_-7410404075519366896 for deletion
2013-10-31 20:35:09,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4718961324494384221_1120 file build/test/data/dfs/data/data3/current/blk_4718961324494384221 for deletion
2013-10-31 20:35:09,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7410404075519366896_1121 at file build/test/data/dfs/data/data4/current/blk_-7410404075519366896
2013-10-31 20:35:09,339 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4718961324494384221_1120 at file build/test/data/dfs/data/data3/current/blk_4718961324494384221
2013-10-31 20:35:09,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8594137634848644750_1118 file build/test/data/dfs/data/data5/current/blk_-8594137634848644750 for deletion
2013-10-31 20:35:09,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7410404075519366896_1121 file build/test/data/dfs/data/data5/current/blk_-7410404075519366896 for deletion
2013-10-31 20:35:09,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8594137634848644750_1118 at file build/test/data/dfs/data/data5/current/blk_-8594137634848644750
2013-10-31 20:35:09,783 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2379598675974902431_1128 file build/test/data/dfs/data/data6/current/blk_-2379598675974902431 for deletion
2013-10-31 20:35:09,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7410404075519366896_1121 at file build/test/data/dfs/data/data5/current/blk_-7410404075519366896
2013-10-31 20:35:09,784 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2379598675974902431_1128 at file build/test/data/dfs/data/data6/current/blk_-2379598675974902431
2013-10-31 20:35:10,110 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_1923996118185355645_1011
2013-10-31 20:35:10,587 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_m_000003_0 0.0% setup
2013-10-31 20:35:10,590 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0015_m_000003_0 is done.
2013-10-31 20:35:10,590 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0015_m_000003_0 was -1
2013-10-31 20:35:10,591 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:10,795 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0015_m_000003_0' has completed task_20131031202710049_0015_m_000003 successfully.
2013-10-31 20:35:10,800 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0015_m_000000_0' to tip task_20131031202710049_0015_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:35:10,801 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0015_m_000000
2013-10-31 20:35:10,803 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0015_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:35:10,803 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0015_m_000000_0 which needs 1 slots
2013-10-31 20:35:10,803 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0015_m_000000_0 which needs 1 slots
2013-10-31 20:35:10,841 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0015_m_1565820870
2013-10-31 20:35:10,842 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0015_m_1565820870 spawned.
2013-10-31 20:35:10,845 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0015/attempt_20131031202710049_0015_m_000000_0/taskjvm.sh
2013-10-31 20:35:11,865 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0015_m_1565820870 given task: attempt_20131031202710049_0015_m_000000_0
2013-10-31 20:35:12,111 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0015_m_000001_0' to tip task_20131031202710049_0015_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:35:12,112 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0015_m_000001
2013-10-31 20:35:12,112 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0015_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:35:12,112 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0015_m_000001_0 which needs 1 slots
2013-10-31 20:35:12,113 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0015_m_000001_0 which needs 1 slots
2013-10-31 20:35:12,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015/jobToken dst=null perm=null
2013-10-31 20:35:12,117 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40293, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4230247361908926647_1137, duration: 142029
2013-10-31 20:35:12,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.xml dst=null perm=null
2013-10-31 20:35:12,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36201, bytes: 29581, op: HDFS_READ, cliID: DFSClient_-528259771, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8954546216927232859_1134, duration: 150935
2013-10-31 20:35:12,135 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:35:12,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.jar dst=null perm=null
2013-10-31 20:35:12,150 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44588, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-528259771, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6440951044851290042_1131, duration: 661963
2013-10-31 20:35:12,202 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0015_m_1940325653
2013-10-31 20:35:12,202 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0015_m_1940325653 spawned.
2013-10-31 20:35:12,205 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0015/attempt_20131031202710049_0015_m_000001_0/taskjvm.sh
2013-10-31 20:35:12,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split dst=null perm=null
2013-10-31 20:35:12,491 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34808, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0015_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7982900489810622284_1132, duration: 244082
2013-10-31 20:35:12,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:35:12,786 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34809, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0015_m_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4376294229090259720_1013, duration: 141839
2013-10-31 20:35:13,246 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0015_m_1940325653 given task: attempt_20131031202710049_0015_m_000001_0
2013-10-31 20:35:13,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015/job.split dst=null perm=null
2013-10-31 20:35:13,752 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36208, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0015_m_000001_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7982900489810622284_1132, duration: 352562
2013-10-31 20:35:13,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:35:14,052 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36209, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0015_m_000001_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1710730409183361578_1012, duration: 109103
2013-10-31 20:35:15,387 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:35:15,390 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0015_m_000000_0 is done.
2013-10-31 20:35:15,390 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0015_m_000000_0 was 335
2013-10-31 20:35:15,391 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:15,803 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0015_m_000003_0
2013-10-31 20:35:15,804 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0015_m_000003_0
2013-10-31 20:35:15,804 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0015_m_000003_0 not found in cache
2013-10-31 20:35:16,676 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:35:16,678 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0015_m_000001_0 is done.
2013-10-31 20:35:16,678 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0015_m_000001_0 was 335
2013-10-31 20:35:16,679 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:16,808 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0015_m_000000_0' has completed task_20131031202710049_0015_m_000000 successfully.
2013-10-31 20:35:16,810 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0015_r_000000_0' to tip task_20131031202710049_0015_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:35:16,812 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0015_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:35:16,813 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0015_r_000000_0 which needs 1 slots
2013-10-31 20:35:16,813 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0015_r_000000_0 which needs 1 slots
2013-10-31 20:35:16,845 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0015_r_583226979
2013-10-31 20:35:16,846 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0015_r_583226979 spawned.
2013-10-31 20:35:16,847 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0015/attempt_20131031202710049_0015_r_000000_0/taskjvm.sh
2013-10-31 20:35:17,789 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0015_r_583226979 given task: attempt_20131031202710049_0015_r_000000_0
2013-10-31 20:35:18,118 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0015_m_000001_0' has completed task_20131031202710049_0015_m_000001 successfully.
2013-10-31 20:35:23,509 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53483, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0015_m_000000_0, duration: 9752216
2013-10-31 20:35:23,537 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53858, bytes: 335, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0015_m_000001_0, duration: 12837839
2013-10-31 20:35:24,312 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:35:24,365 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:35:24,431 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:35:24,620 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 728 Total time for transactions(ms): 15Number of transactions batched in Syncs: 24 Number of syncs: 501 SyncTimes(ms): 9886 2298
2013-10-31 20:35:24,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:24,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:24,675 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0/part-00000. blk_5191893024991787107_1138
2013-10-31 20:35:24,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5191893024991787107_1138 src: /127.0.0.1:40309 dest: /127.0.0.1:46399
2013-10-31 20:35:24,711 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5191893024991787107_1138 src: /127.0.0.1:36216 dest: /127.0.0.1:49827
2013-10-31 20:35:24,712 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5191893024991787107_1138 src: /127.0.0.1:44603 dest: /127.0.0.1:33202
2013-10-31 20:35:24,716 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44603, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0015_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5191893024991787107_1138, duration: 2243937
2013-10-31 20:35:24,716 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5191893024991787107_1138 terminating
2013-10-31 20:35:24,717 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36216, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0015_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_5191893024991787107_1138, duration: 3412964
2013-10-31 20:35:24,717 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5191893024991787107_1138 terminating
2013-10-31 20:35:24,717 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40309, dest: /127.0.0.1:46399, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0015_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5191893024991787107_1138, duration: 4057035
2013-10-31 20:35:24,717 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5191893024991787107_1138 size 708
2013-10-31 20:35:24,718 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5191893024991787107_1138 terminating
2013-10-31 20:35:24,719 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5191893024991787107_1138 size 708
2013-10-31 20:35:24,722 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0015_r_000000_0
2013-10-31 20:35:24,722 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0015_r_000000_0
2013-10-31 20:35:24,722 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_5191893024991787107_1138 size 708
2013-10-31 20:35:24,760 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0015_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:35:24,760 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:35:25,820 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0015_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:35:25,821 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0015_r_000000_0
2013-10-31 20:35:26,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0 dst=null perm=null
2013-10-31 20:35:26,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:26,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:26,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary/_attempt_20131031202710049_0015_r_000000_0 dst=null perm=null
2013-10-31 20:35:27,361 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_r_000000_0 1.0% reduce > reduce
2013-10-31 20:35:27,363 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_r_000000_0 1.0% reduce > reduce
2013-10-31 20:35:27,364 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0015_r_000000_0 is done.
2013-10-31 20:35:27,364 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0015_r_000000_0 was -1
2013-10-31 20:35:27,365 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:28,825 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0015_r_000000_0' has completed task_20131031202710049_0015_r_000000 successfully.
2013-10-31 20:35:28,831 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0015_m_000002_0' to tip task_20131031202710049_0015_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:35:28,833 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0015_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:35:28,833 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0015_m_000002_0 which needs 1 slots
2013-10-31 20:35:28,833 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0015_m_000002_0 which needs 1 slots
2013-10-31 20:35:28,865 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0015/attempt_20131031202710049_0015_m_000002_0. Attempting to reuse: jvm_20131031202710049_0015_m_1565820870
2013-10-31 20:35:29,465 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0015_m_1565820870 given task: attempt_20131031202710049_0015_m_000002_0
2013-10-31 20:35:29,599 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_m_000002_0 0.0%
2013-10-31 20:35:29,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_temporary dst=null perm=null
2013-10-31 20:35:29,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:29,617 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_SUCCESS from client DFSClient_attempt_20131031202710049_0015_m_000002_0
2013-10-31 20:35:29,617 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0015_m_000002_0
2013-10-31 20:35:29,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6440951044851290042 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:29,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6440951044851290042 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:35:29,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6440951044851290042 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:29,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6440951044851290042 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:29,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7982900489810622284 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:29,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7982900489810622284 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:29,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7982900489810622284 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:35:29,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7982900489810622284 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:29,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3568828130362572904 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:29,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3568828130362572904 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:35:29,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3568828130362572904 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:29,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8954546216927232859 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:29,627 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8954546216927232859 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:35:29,627 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8954546216927232859 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:29,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0015 dst=null perm=null
2013-10-31 20:35:31,481 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-7982900489810622284_1132 blk_3568828130362572904_1133 blk_6440951044851290042_1131
2013-10-31 20:35:31,481 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-7982900489810622284_1132 blk_3568828130362572904_1133 blk_6440951044851290042_1131 blk_-8954546216927232859_1134
2013-10-31 20:35:32,550 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0015_m_000002_0 0.0% cleanup
2013-10-31 20:35:32,552 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0015_m_000002_0 is done.
2013-10-31 20:35:32,552 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0015_m_000002_0 was -1
2013-10-31 20:35:32,553 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:32,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7982900489810622284_1132 file build/test/data/dfs/data/data1/current/blk_-7982900489810622284 for deletion
2013-10-31 20:35:32,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3568828130362572904_1133 file build/test/data/dfs/data/data2/current/blk_3568828130362572904 for deletion
2013-10-31 20:35:32,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7982900489810622284_1132 at file build/test/data/dfs/data/data1/current/blk_-7982900489810622284
2013-10-31 20:35:32,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6440951044851290042_1131 file build/test/data/dfs/data/data2/current/blk_6440951044851290042 for deletion
2013-10-31 20:35:32,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3568828130362572904_1133 at file build/test/data/dfs/data/data2/current/blk_3568828130362572904
2013-10-31 20:35:32,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6440951044851290042_1131 at file build/test/data/dfs/data/data2/current/blk_6440951044851290042
2013-10-31 20:35:33,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8954546216927232859_1134 file build/test/data/dfs/data/data3/current/blk_-8954546216927232859 for deletion
2013-10-31 20:35:33,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7982900489810622284_1132 file build/test/data/dfs/data/data3/current/blk_-7982900489810622284 for deletion
2013-10-31 20:35:33,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8954546216927232859_1134 at file build/test/data/dfs/data/data3/current/blk_-8954546216927232859
2013-10-31 20:35:33,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3568828130362572904_1133 file build/test/data/dfs/data/data4/current/blk_3568828130362572904 for deletion
2013-10-31 20:35:33,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7982900489810622284_1132 at file build/test/data/dfs/data/data3/current/blk_-7982900489810622284
2013-10-31 20:35:33,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6440951044851290042_1131 file build/test/data/dfs/data/data4/current/blk_6440951044851290042 for deletion
2013-10-31 20:35:33,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3568828130362572904_1133 at file build/test/data/dfs/data/data4/current/blk_3568828130362572904
2013-10-31 20:35:33,348 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6440951044851290042_1131 at file build/test/data/dfs/data/data4/current/blk_6440951044851290042
2013-10-31 20:35:33,834 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0015_r_000000_0
2013-10-31 20:35:33,834 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0015_r_000000_0
2013-10-31 20:35:34,481 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-7982900489810622284_1132 blk_3568828130362572904_1133 blk_6440951044851290042_1131 blk_-8954546216927232859_1134
2013-10-31 20:35:34,482 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-7982900489810622284_1132 blk_6440951044851290042_1131 blk_-8954546216927232859_1134
2013-10-31 20:35:34,841 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0015_m_000002_0' has completed task_20131031202710049_0015_m_000002 successfully.
2013-10-31 20:35:34,842 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0015 has completed successfully.
2013-10-31 20:35:34,843 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0015,submitTime=1383251703441,launchTime=1383251703831,firstMapTaskLaunchTime=1383251710800,firstReduceTaskLaunchTime=1383251716810,firstJobSetupTaskLaunchTime=1383251704782,firstJobCleanupTaskLaunchTime=1383251728831,finishTime=1383251734842,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=18,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3BBD4688B05646BFB8DEE6C5EED71EB6/790E78452B2F4BB4899D52D4419EE36B] lower*upper/(1/2)
2013-10-31 20:35:34,849 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_1383251703441_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F790E78452B2F4BB4. blk_3023806889262409912_1139
2013-10-31 20:35:34,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023806889262409912_1139 src: /127.0.0.1:44609 dest: /127.0.0.1:33202
2013-10-31 20:35:34,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023806889262409912_1139 src: /127.0.0.1:36224 dest: /127.0.0.1:49827
2013-10-31 20:35:34,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023806889262409912_1139 src: /127.0.0.1:34829 dest: /127.0.0.1:37249
2013-10-31 20:35:34,867 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34829, dest: /127.0.0.1:37249, bytes: 20684, op: HDFS_WRITE, cliID: DFSClient_930556513, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3023806889262409912_1139, duration: 5045196
2013-10-31 20:35:34,867 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3023806889262409912_1139 terminating
2013-10-31 20:35:34,868 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36224, dest: /127.0.0.1:49827, bytes: 20684, op: HDFS_WRITE, cliID: DFSClient_930556513, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3023806889262409912_1139, duration: 5719249
2013-10-31 20:35:34,868 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3023806889262409912_1139 size 20684
2013-10-31 20:35:34,868 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3023806889262409912_1139 terminating
2013-10-31 20:35:34,870 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44609, dest: /127.0.0.1:33202, bytes: 20684, op: HDFS_WRITE, cliID: DFSClient_930556513, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3023806889262409912_1139, duration: 9484589
2013-10-31 20:35:34,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3023806889262409912_1139 size 20684
2013-10-31 20:35:34,870 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3023806889262409912_1139 terminating
2013-10-31 20:35:34,872 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3023806889262409912_1139 size 20684
2013-10-31 20:35:34,873 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_1383251703441_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F790E78452B2F4BB4 from client DFSClient_930556513
2013-10-31 20:35:34,873 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/_logs/history/job_20131031202710049_0015_1383251703441_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F790E78452B2F4BB4 is closed by DFSClient_930556513
2013-10-31 20:35:34,883 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0015_1383251703441_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F790E78452B2F4BB4 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:35:34,884 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0015_m_000000_0'
2013-10-31 20:35:34,884 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0015_m_000002_0'
2013-10-31 20:35:34,884 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0015_m_000003_0'
2013-10-31 20:35:34,884 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0015_r_000000_0'
2013-10-31 20:35:34,886 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4230247361908926647 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:35:34,886 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4230247361908926647 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:35:34,886 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4230247361908926647 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:35:34,889 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0015_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:35:34,890 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...lue/true/true/false/false
2013-10-31 20:35:34,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0015 dst=null perm=null
2013-10-31 20:35:34,898 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:35:34,899 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:35:34,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:34,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:35:34,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:34,920 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar. blk_4078679559254430485_1140
2013-10-31 20:35:34,922 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4078679559254430485_1140 src: /127.0.0.1:34831 dest: /127.0.0.1:37249
2013-10-31 20:35:34,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4078679559254430485_1140 src: /127.0.0.1:40322 dest: /127.0.0.1:46399
2013-10-31 20:35:34,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4078679559254430485_1140 src: /127.0.0.1:36229 dest: /127.0.0.1:49827
2013-10-31 20:35:34,933 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36229, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4078679559254430485_1140, duration: 4983342
2013-10-31 20:35:34,934 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4078679559254430485_1140 terminating
2013-10-31 20:35:34,935 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_4078679559254430485_1140 size 238055
2013-10-31 20:35:34,935 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40322, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4078679559254430485_1140, duration: 7117780
2013-10-31 20:35:34,936 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4078679559254430485_1140 terminating
2013-10-31 20:35:34,937 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34831, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4078679559254430485_1140, duration: 8338028
2013-10-31 20:35:34,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4078679559254430485_1140 terminating
2013-10-31 20:35:34,940 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar from client DFSClient_848976415
2013-10-31 20:35:34,941 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar is closed by DFSClient_848976415
2013-10-31 20:35:34,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_4078679559254430485_1140 size 238055
2013-10-31 20:35:34,942 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_4078679559254430485_1140 size 238055
2013-10-31 20:35:34,947 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar. New replication is 10
2013-10-31 20:35:35,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar dst=null perm=null
2013-10-31 20:35:35,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,176 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:35:35,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8 dst=null perm=null
2013-10-31 20:35:35,183 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:35:35,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/part-00000 dst=null perm=null
2013-10-31 20:35:35,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,196 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split. New replication is 10
2013-10-31 20:35:35,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split dst=null perm=null
2013-10-31 20:35:35,202 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split. blk_-7954676720405413274_1141
2013-10-31 20:35:35,204 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7954676720405413274_1141 src: /127.0.0.1:44616 dest: /127.0.0.1:33202
2013-10-31 20:35:35,206 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7954676720405413274_1141 src: /127.0.0.1:40325 dest: /127.0.0.1:46399
2013-10-31 20:35:35,207 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7954676720405413274_1141 src: /127.0.0.1:36232 dest: /127.0.0.1:49827
2013-10-31 20:35:35,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7954676720405413274_1141 src: /127.0.0.1:34837 dest: /127.0.0.1:37249
2013-10-31 20:35:35,213 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34837, dest: /127.0.0.1:37249, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7954676720405413274_1141, duration: 942411
2013-10-31 20:35:35,213 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7954676720405413274_1141 terminating
2013-10-31 20:35:35,215 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36232, dest: /127.0.0.1:49827, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7954676720405413274_1141, duration: 2623395
2013-10-31 20:35:35,215 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7954676720405413274_1141 terminating
2013-10-31 20:35:35,217 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7954676720405413274_1141 size 358
2013-10-31 20:35:35,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40325, dest: /127.0.0.1:46399, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7954676720405413274_1141, duration: 4304005
2013-10-31 20:35:35,217 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7954676720405413274_1141 size 358
2013-10-31 20:35:35,218 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7954676720405413274_1141 terminating
2013-10-31 20:35:35,219 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44616, dest: /127.0.0.1:33202, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7954676720405413274_1141, duration: 6905293
2013-10-31 20:35:35,219 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7954676720405413274_1141 size 358
2013-10-31 20:35:35,220 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7954676720405413274_1141 terminating
2013-10-31 20:35:35,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7954676720405413274_1141 size 358
2013-10-31 20:35:35,228 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split from client DFSClient_848976415
2013-10-31 20:35:35,229 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split is closed by DFSClient_848976415
2013-10-31 20:35:35,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,246 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.splitmetainfo. blk_7156624117710656062_1142
2013-10-31 20:35:35,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7156624117710656062_1142 src: /127.0.0.1:40328 dest: /127.0.0.1:46399
2013-10-31 20:35:35,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7156624117710656062_1142 src: /127.0.0.1:44621 dest: /127.0.0.1:33202
2013-10-31 20:35:35,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7156624117710656062_1142 src: /127.0.0.1:34840 dest: /127.0.0.1:37249
2013-10-31 20:35:35,254 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34840, dest: /127.0.0.1:37249, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7156624117710656062_1142, duration: 865770
2013-10-31 20:35:35,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7156624117710656062_1142 terminating
2013-10-31 20:35:35,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44621, dest: /127.0.0.1:33202, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7156624117710656062_1142, duration: 2442281
2013-10-31 20:35:35,256 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7156624117710656062_1142 terminating
2013-10-31 20:35:35,258 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40328, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7156624117710656062_1142, duration: 4308758
2013-10-31 20:35:35,258 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7156624117710656062_1142 terminating
2013-10-31 20:35:35,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7156624117710656062_1142 size 45
2013-10-31 20:35:35,260 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:35:35,261 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:35:35,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7156624117710656062_1142 size 45
2013-10-31 20:35:35,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7156624117710656062_1142 size 45
2013-10-31 20:35:35,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,284 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml. blk_-1432510737412584353_1143
2013-10-31 20:35:35,286 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1432510737412584353_1143 src: /127.0.0.1:40331 dest: /127.0.0.1:46399
2013-10-31 20:35:35,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1432510737412584353_1143 src: /127.0.0.1:34842 dest: /127.0.0.1:37249
2013-10-31 20:35:35,289 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1432510737412584353_1143 src: /127.0.0.1:44625 dest: /127.0.0.1:33202
2013-10-31 20:35:35,293 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44625, dest: /127.0.0.1:33202, bytes: 28877, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1432510737412584353_1143, duration: 1786244
2013-10-31 20:35:35,294 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1432510737412584353_1143 terminating
2013-10-31 20:35:35,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34842, dest: /127.0.0.1:37249, bytes: 28877, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1432510737412584353_1143, duration: 3391711
2013-10-31 20:35:35,296 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1432510737412584353_1143 terminating
2013-10-31 20:35:35,297 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40331, dest: /127.0.0.1:46399, bytes: 28877, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1432510737412584353_1143, duration: 4930929
2013-10-31 20:35:35,297 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1432510737412584353_1143 terminating
2013-10-31 20:35:35,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1432510737412584353_1143 size 28877
2013-10-31 20:35:35,299 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml from client DFSClient_848976415
2013-10-31 20:35:35,300 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml is closed by DFSClient_848976415
2013-10-31 20:35:35,300 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1432510737412584353_1143 size 28877
2013-10-31 20:35:35,300 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1432510737412584353_1143 size 28877
2013-10-31 20:35:35,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml dst=null perm=null
2013-10-31 20:35:35,318 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44627, bytes: 29105, op: HDFS_READ, cliID: DFSClient_358193244, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1432510737412584353_1143, duration: 398488
2013-10-31 20:35:35,337 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0016: nMaps=1 nReduces=1 max=-1
2013-10-31 20:35:35,337 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0016 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:35:35,338 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0016 RESULT=SUCCESS
2013-10-31 20:35:35,338 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0016
2013-10-31 20:35:35,338 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0016
2013-10-31 20:35:35,339 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0016
2013-10-31 20:35:35,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_1383251735308_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F0D1910A6F0A0478F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,359 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_conf.xml. blk_7865546840970228319_1145
2013-10-31 20:35:35,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7865546840970228319_1145 src: /127.0.0.1:40336 dest: /127.0.0.1:46399
2013-10-31 20:35:35,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7865546840970228319_1145 src: /127.0.0.1:34847 dest: /127.0.0.1:37249
2013-10-31 20:35:35,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7865546840970228319_1145 src: /127.0.0.1:36244 dest: /127.0.0.1:49827
2013-10-31 20:35:35,367 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36244, dest: /127.0.0.1:49827, bytes: 28942, op: HDFS_WRITE, cliID: DFSClient_358193244, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7865546840970228319_1145, duration: 2401703
2013-10-31 20:35:35,367 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7865546840970228319_1145 terminating
2013-10-31 20:35:35,368 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34847, dest: /127.0.0.1:37249, bytes: 28942, op: HDFS_WRITE, cliID: DFSClient_358193244, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7865546840970228319_1145, duration: 3189588
2013-10-31 20:35:35,368 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7865546840970228319_1145 terminating
2013-10-31 20:35:35,368 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40336, dest: /127.0.0.1:46399, bytes: 28942, op: HDFS_WRITE, cliID: DFSClient_358193244, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7865546840970228319_1145, duration: 4228925
2013-10-31 20:35:35,369 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7865546840970228319_1145 terminating
2013-10-31 20:35:35,371 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7865546840970228319_1145 size 28942
2013-10-31 20:35:35,372 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7865546840970228319_1145 size 28942
2013-10-31 20:35:35,373 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7865546840970228319_1145 size 28942
2013-10-31 20:35:35,770 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_conf.xml from client DFSClient_358193244
2013-10-31 20:35:35,771 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_conf.xml is closed by DFSClient_358193244
2013-10-31 20:35:35,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:35,955 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016/jobToken. blk_-2487173678132909357_1146
2013-10-31 20:35:35,957 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2487173678132909357_1146 src: /127.0.0.1:34849 dest: /127.0.0.1:37249
2013-10-31 20:35:35,959 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2487173678132909357_1146 src: /127.0.0.1:40340 dest: /127.0.0.1:46399
2013-10-31 20:35:35,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2487173678132909357_1146 src: /127.0.0.1:36247 dest: /127.0.0.1:49827
2013-10-31 20:35:35,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36247, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2487173678132909357_1146, duration: 2209376
2013-10-31 20:35:35,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2487173678132909357_1146 terminating
2013-10-31 20:35:35,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40340, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2487173678132909357_1146, duration: 5143688
2013-10-31 20:35:35,969 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2487173678132909357_1146 terminating
2013-10-31 20:35:35,970 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34849, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2487173678132909357_1146, duration: 6295319
2013-10-31 20:35:35,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2487173678132909357_1146 terminating
2013-10-31 20:35:35,972 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-2487173678132909357_1146 size 116
2013-10-31 20:35:35,972 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016/jobToken from client DFSClient_848976415
2013-10-31 20:35:35,973 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016/jobToken is closed by DFSClient_848976415
2013-10-31 20:35:35,973 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-2487173678132909357_1146 size 116
2013-10-31 20:35:35,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-2487173678132909357_1146 size 116
2013-10-31 20:35:35,977 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016/jobToken
2013-10-31 20:35:35,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.splitmetainfo dst=null perm=null
2013-10-31 20:35:35,982 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34852, bytes: 49, op: HDFS_READ, cliID: DFSClient_358193244, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7156624117710656062_1142, duration: 264106
2013-10-31 20:35:35,982 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0016 = 708. Number of splits = 1
2013-10-31 20:35:35,983 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:35,983 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:35,983 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:35:35,983 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0016 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:35:35,984 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0016 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:35:36,139 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0016_m_000002_0' to tip task_20131031202710049_0016_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:35:36,143 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0015_m_000001_0'
2013-10-31 20:35:36,145 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0016_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:35:36,145 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0016_m_000002_0 which needs 1 slots
2013-10-31 20:35:36,145 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0016_m_000002_0 which needs 1 slots
2013-10-31 20:35:36,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016/jobToken dst=null perm=null
2013-10-31 20:35:36,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40343, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2487173678132909357_1146, duration: 272737
2013-10-31 20:35:36,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.xml dst=null perm=null
2013-10-31 20:35:36,166 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40345, bytes: 29105, op: HDFS_READ, cliID: DFSClient_2077000744, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1432510737412584353_1143, duration: 366517
2013-10-31 20:35:36,198 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:35:36,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.jar dst=null perm=null
2013-10-31 20:35:36,230 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40346, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2077000744, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4078679559254430485_1140, duration: 1359455
2013-10-31 20:35:36,340 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0016_m_2127242113
2013-10-31 20:35:36,341 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0016_m_2127242113 spawned.
2013-10-31 20:35:36,342 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0016/attempt_20131031202710049_0016_m_000002_0/taskjvm.sh
2013-10-31 20:35:36,385 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0015
2013-10-31 20:35:36,385 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0015 being deleted.
2013-10-31 20:35:36,645 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0015
2013-10-31 20:35:36,645 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0015 being deleted.
2013-10-31 20:35:36,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8954546216927232859_1134 file build/test/data/dfs/data/data5/current/blk_-8954546216927232859 for deletion
2013-10-31 20:35:36,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7982900489810622284_1132 file build/test/data/dfs/data/data5/current/blk_-7982900489810622284 for deletion
2013-10-31 20:35:36,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8954546216927232859_1134 at file build/test/data/dfs/data/data5/current/blk_-8954546216927232859
2013-10-31 20:35:36,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3568828130362572904_1133 file build/test/data/dfs/data/data6/current/blk_3568828130362572904 for deletion
2013-10-31 20:35:36,793 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7982900489810622284_1132 at file build/test/data/dfs/data/data5/current/blk_-7982900489810622284
2013-10-31 20:35:36,793 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3568828130362572904_1133 at file build/test/data/dfs/data/data6/current/blk_3568828130362572904
2013-10-31 20:35:36,793 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6440951044851290042_1131 file build/test/data/dfs/data/data6/current/blk_6440951044851290042 for deletion
2013-10-31 20:35:36,794 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6440951044851290042_1131 at file build/test/data/dfs/data/data6/current/blk_6440951044851290042
2013-10-31 20:35:37,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8954546216927232859_1134 file build/test/data/dfs/data/data7/current/blk_-8954546216927232859 for deletion
2013-10-31 20:35:37,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7982900489810622284_1132 file build/test/data/dfs/data/data8/current/blk_-7982900489810622284 for deletion
2013-10-31 20:35:37,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6440951044851290042_1131 file build/test/data/dfs/data/data7/current/blk_6440951044851290042 for deletion
2013-10-31 20:35:37,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8954546216927232859_1134 at file build/test/data/dfs/data/data7/current/blk_-8954546216927232859
2013-10-31 20:35:37,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7982900489810622284_1132 at file build/test/data/dfs/data/data8/current/blk_-7982900489810622284
2013-10-31 20:35:37,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6440951044851290042_1131 at file build/test/data/dfs/data/data7/current/blk_6440951044851290042
2013-10-31 20:35:37,483 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:49827 to replicate blk_4078679559254430485_1140 to datanode(s) 127.0.0.1:33202
2013-10-31 20:35:37,483 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-4230247361908926647_1137
2013-10-31 20:35:37,483 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-4230247361908926647_1137
2013-10-31 20:35:37,532 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0016_m_2127242113 given task: attempt_20131031202710049_0016_m_000002_0
2013-10-31 20:35:38,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:38,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4230247361908926647_1137 file build/test/data/dfs/data/data2/current/blk_-4230247361908926647 for deletion
2013-10-31 20:35:38,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4230247361908926647_1137 at file build/test/data/dfs/data/data2/current/blk_-4230247361908926647
2013-10-31 20:35:39,793 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4230247361908926647_1137 file build/test/data/dfs/data/data5/current/blk_-4230247361908926647 for deletion
2013-10-31 20:35:39,793 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4230247361908926647_1137 at file build/test/data/dfs/data/data5/current/blk_-4230247361908926647
2013-10-31 20:35:39,886 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0015
2013-10-31 20:35:39,887 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0015_m_000002_0 not found in cache
2013-10-31 20:35:39,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0015 for user-log deletion with retainTimeStamp:1383338139888
2013-10-31 20:35:39,904 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0015_r_583226979 since job job_20131031202710049_0015 is dead
2013-10-31 20:35:39,929 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32663 with signal TERM. Exit code 0
2013-10-31 20:35:40,094 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:40,094 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:40,094 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:40,095 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0015_r_583226979 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:35:40,174 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207) Starting thread to transfer block blk_4078679559254430485_1140 to 127.0.0.1:33202
2013-10-31 20:35:40,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4078679559254430485_1140 src: /127.0.0.1:44641 dest: /127.0.0.1:33202
2013-10-31 20:35:40,176 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:49827, storageID=DS-1604804401-10.5.128.102-49827-1383251229957, infoPort=36040, ipcPort=38207):Transmitted block blk_4078679559254430485_1140 to /127.0.0.1:33202
2013-10-31 20:35:40,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_4078679559254430485_1140 src: /127.0.0.1:44641 dest: /127.0.0.1:33202 of size 238055
2013-10-31 20:35:40,183 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_4078679559254430485_1140 size 238055
2013-10-31 20:35:40,484 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-4230247361908926647_1137
2013-10-31 20:35:40,590 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0015_m_1565820870 since job job_20131031202710049_0015 is dead
2013-10-31 20:35:40,600 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32519 with signal TERM. Exit code 0
2013-10-31 20:35:40,781 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:40,782 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:40,782 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:40,782 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0015_m_1565820870 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:35:40,949 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_m_000002_0 0.0% setup
2013-10-31 20:35:40,952 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0016_m_000002_0 is done.
2013-10-31 20:35:40,952 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0016_m_000002_0 was -1
2013-10-31 20:35:40,953 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:41,145 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0015
2013-10-31 20:35:41,146 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0015 for user-log deletion with retainTimeStamp:1383338141146
2013-10-31 20:35:41,182 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0015_m_-945716405 since job job_20131031202710049_0015 is dead
2013-10-31 20:35:41,191 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32412 with signal TERM. Exit code 0
2013-10-31 20:35:41,247 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0015_m_1940325653 since job job_20131031202710049_0015 is dead
2013-10-31 20:35:41,252 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32586 with signal TERM. Exit code 0
2013-10-31 20:35:41,355 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:41,355 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:41,355 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:41,356 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0015_m_-945716405 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:35:41,458 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:35:41,458 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:35:41,458 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:35:41,458 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0015_m_1940325653 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:35:42,151 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0016_m_000002_0' has completed task_20131031202710049_0016_m_000002 successfully.
2013-10-31 20:35:42,154 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0016_m_000000_0' to tip task_20131031202710049_0016_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:35:42,156 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0016_m_000000
2013-10-31 20:35:42,157 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0016_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:35:42,158 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0016_m_000000_0 which needs 1 slots
2013-10-31 20:35:42,158 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0016_m_000000_0 which needs 1 slots
2013-10-31 20:35:42,187 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0016_m_-996315330
2013-10-31 20:35:42,188 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0016_m_-996315330 spawned.
2013-10-31 20:35:42,190 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0016/attempt_20131031202710049_0016_m_000000_0/taskjvm.sh
2013-10-31 20:35:43,026 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0016_m_-996315330 given task: attempt_20131031202710049_0016_m_000000_0
2013-10-31 20:35:43,174 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4230247361908926647_1137 file build/test/data/dfs/data/data8/current/blk_-4230247361908926647 for deletion
2013-10-31 20:35:43,174 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4230247361908926647_1137 at file build/test/data/dfs/data/data8/current/blk_-4230247361908926647
2013-10-31 20:35:43,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016/job.split dst=null perm=null
2013-10-31 20:35:43,522 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36258, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0016_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7954676720405413274_1141, duration: 260050
2013-10-31 20:35:43,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/part-00000 dst=null perm=null
2013-10-31 20:35:43,561 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44645, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0016_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5191893024991787107_1138, duration: 345612
2013-10-31 20:35:46,447 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8/part-00000:0+708
2013-10-31 20:35:46,450 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0016_m_000000_0 is done.
2013-10-31 20:35:46,450 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0016_m_000000_0 was 764
2013-10-31 20:35:46,451 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:35:47,158 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0016_m_000002_0
2013-10-31 20:35:47,158 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0016_m_000002_0
2013-10-31 20:35:47,159 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0016_m_000002_0 not found in cache
2013-10-31 20:35:48,164 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0016_m_000000_0' has completed task_20131031202710049_0016_m_000000 successfully.
2013-10-31 20:35:48,166 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0016_r_000000_0' to tip task_20131031202710049_0016_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:35:48,168 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0016_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:35:48,169 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0016_r_000000_0 which needs 1 slots
2013-10-31 20:35:48,169 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0016_r_000000_0 which needs 1 slots
2013-10-31 20:35:48,204 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0016_r_-1858196187
2013-10-31 20:35:48,205 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0016_r_-1858196187 spawned.
2013-10-31 20:35:48,207 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0016/attempt_20131031202710049_0016_r_000000_0/taskjvm.sh
2013-10-31 20:35:49,102 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0016_r_-1858196187 given task: attempt_20131031202710049_0016_r_000000_0
2013-10-31 20:35:54,795 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53908, bytes: 764, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0016_m_000000_0, duration: 5906812
2013-10-31 20:35:55,586 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:35:55,657 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:35:55,714 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:35:55,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:55,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:55,956 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0/part-00000. blk_-478630356935697483_1147
2013-10-31 20:35:55,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-478630356935697483_1147 src: /127.0.0.1:40359 dest: /127.0.0.1:46399
2013-10-31 20:35:55,979 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-478630356935697483_1147 src: /127.0.0.1:34870 dest: /127.0.0.1:37249
2013-10-31 20:35:55,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-478630356935697483_1147 src: /127.0.0.1:36267 dest: /127.0.0.1:49827
2013-10-31 20:35:55,984 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36267, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0016_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-478630356935697483_1147, duration: 1731426
2013-10-31 20:35:55,985 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-478630356935697483_1147 terminating
2013-10-31 20:35:55,986 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34870, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0016_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-478630356935697483_1147, duration: 4073369
2013-10-31 20:35:55,986 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-478630356935697483_1147 terminating
2013-10-31 20:35:55,987 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40359, dest: /127.0.0.1:46399, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0016_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-478630356935697483_1147, duration: 5926756
2013-10-31 20:35:55,987 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-478630356935697483_1147 terminating
2013-10-31 20:35:55,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-478630356935697483_1147 size 708
2013-10-31 20:35:55,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-478630356935697483_1147 size 708
2013-10-31 20:35:55,991 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0016_r_000000_0
2013-10-31 20:35:55,991 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0016_r_000000_0
2013-10-31 20:35:55,991 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-478630356935697483_1147 size 708
2013-10-31 20:35:56,038 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0016_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:35:56,039 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:35:57,178 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0016_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:35:57,180 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0016_r_000000_0
2013-10-31 20:35:58,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0 dst=null perm=null
2013-10-31 20:35:58,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:35:58,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:35:58,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary/_attempt_20131031202710049_0016_r_000000_0 dst=null perm=null
2013-10-31 20:35:58,636 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_r_000000_0 1.0% reduce > reduce
2013-10-31 20:35:58,639 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_r_000000_0 1.0% reduce > reduce
2013-10-31 20:35:58,639 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0016_r_000000_0 is done.
2013-10-31 20:35:58,639 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0016_r_000000_0 was -1
2013-10-31 20:35:58,640 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:00,185 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0016_r_000000_0' has completed task_20131031202710049_0016_r_000000 successfully.
2013-10-31 20:36:00,189 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0016_m_000001_0' to tip task_20131031202710049_0016_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:36:00,191 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0016_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:36:00,191 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0016_m_000001_0 which needs 1 slots
2013-10-31 20:36:00,191 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0016_m_000001_0 which needs 1 slots
2013-10-31 20:36:00,225 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0016/attempt_20131031202710049_0016_m_000001_0. Attempting to reuse: jvm_20131031202710049_0016_m_2127242113
2013-10-31 20:36:01,036 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0016_m_2127242113 given task: attempt_20131031202710049_0016_m_000001_0
2013-10-31 20:36:01,174 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_m_000001_0 0.0%
2013-10-31 20:36:01,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary dst=null perm=null
2013-10-31 20:36:01,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:01,204 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_SUCCESS from client DFSClient_attempt_20131031202710049_0016_m_000001_0
2013-10-31 20:36:01,204 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0016_m_000001_0
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4078679559254430485 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4078679559254430485 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4078679559254430485 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4078679559254430485 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7954676720405413274 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7954676720405413274 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7954676720405413274 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7954676720405413274 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7156624117710656062 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:01,213 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7156624117710656062 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:01,214 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7156624117710656062 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:01,214 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1432510737412584353 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:01,214 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1432510737412584353 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:01,214 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1432510737412584353 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:01,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0016 dst=null perm=null
2013-10-31 20:36:01,487 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-7954676720405413274_1141 blk_4078679559254430485_1140 blk_-1432510737412584353_1143 blk_7156624117710656062_1142
2013-10-31 20:36:01,487 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-7954676720405413274_1141 blk_4078679559254430485_1140
2013-10-31 20:36:03,801 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7954676720405413274_1141 file build/test/data/dfs/data/data6/current/blk_-7954676720405413274 for deletion
2013-10-31 20:36:03,801 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1432510737412584353_1143 file build/test/data/dfs/data/data6/current/blk_-1432510737412584353 for deletion
2013-10-31 20:36:03,801 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7954676720405413274_1141 at file build/test/data/dfs/data/data6/current/blk_-7954676720405413274
2013-10-31 20:36:03,801 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4078679559254430485_1140 file build/test/data/dfs/data/data5/current/blk_4078679559254430485 for deletion
2013-10-31 20:36:03,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1432510737412584353_1143 at file build/test/data/dfs/data/data6/current/blk_-1432510737412584353
2013-10-31 20:36:03,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7156624117710656062_1142 file build/test/data/dfs/data/data5/current/blk_7156624117710656062 for deletion
2013-10-31 20:36:03,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4078679559254430485_1140 at file build/test/data/dfs/data/data5/current/blk_4078679559254430485
2013-10-31 20:36:03,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7156624117710656062_1142 at file build/test/data/dfs/data/data5/current/blk_7156624117710656062
2013-10-31 20:36:04,136 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0016_m_000001_0 0.0% cleanup
2013-10-31 20:36:04,137 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0016_m_000001_0 is done.
2013-10-31 20:36:04,138 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0016_m_000001_0 was -1
2013-10-31 20:36:04,138 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:04,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7954676720405413274_1141 file build/test/data/dfs/data/data7/current/blk_-7954676720405413274 for deletion
2013-10-31 20:36:04,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4078679559254430485_1140 file build/test/data/dfs/data/data8/current/blk_4078679559254430485 for deletion
2013-10-31 20:36:04,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7954676720405413274_1141 at file build/test/data/dfs/data/data7/current/blk_-7954676720405413274
2013-10-31 20:36:04,183 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4078679559254430485_1140 at file build/test/data/dfs/data/data8/current/blk_4078679559254430485
2013-10-31 20:36:04,488 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-7954676720405413274_1141 blk_4078679559254430485_1140 blk_-1432510737412584353_1143 blk_7156624117710656062_1142
2013-10-31 20:36:04,488 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-7954676720405413274_1141 blk_4078679559254430485_1140 blk_-1432510737412584353_1143 blk_7156624117710656062_1142
2013-10-31 20:36:05,192 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0016_r_000000_0
2013-10-31 20:36:05,192 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0016_r_000000_0
2013-10-31 20:36:05,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7954676720405413274_1141 file build/test/data/dfs/data/data1/current/blk_-7954676720405413274 for deletion
2013-10-31 20:36:05,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1432510737412584353_1143 file build/test/data/dfs/data/data1/current/blk_-1432510737412584353 for deletion
2013-10-31 20:36:05,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7954676720405413274_1141 at file build/test/data/dfs/data/data1/current/blk_-7954676720405413274
2013-10-31 20:36:05,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4078679559254430485_1140 file build/test/data/dfs/data/data2/current/blk_4078679559254430485 for deletion
2013-10-31 20:36:05,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1432510737412584353_1143 at file build/test/data/dfs/data/data1/current/blk_-1432510737412584353
2013-10-31 20:36:05,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7156624117710656062_1142 file build/test/data/dfs/data/data2/current/blk_7156624117710656062 for deletion
2013-10-31 20:36:05,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4078679559254430485_1140 at file build/test/data/dfs/data/data2/current/blk_4078679559254430485
2013-10-31 20:36:05,912 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7156624117710656062_1142 at file build/test/data/dfs/data/data2/current/blk_7156624117710656062
2013-10-31 20:36:06,199 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0016_m_000001_0' has completed task_20131031202710049_0016_m_000001 successfully.
2013-10-31 20:36:06,200 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0016 has completed successfully.
2013-10-31 20:36:06,201 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0016,submitTime=1383251735308,launchTime=1383251735983,firstMapTaskLaunchTime=1383251742154,firstReduceTaskLaunchTime=1383251748165,firstJobSetupTaskLaunchTime=1383251736139,firstJobCleanupTaskLaunchTime=1383251760189,finishTime=1383251766200,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3BBD4688B05646BFB8DEE6C5EED71EB6/0D1910A6F0A0478F8D16183D004809CF] lower*upper/(2/2) ...lue/true/true/false/false
2013-10-31 20:36:06,207 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_1383251735308_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F0D1910A6F0A0478F. blk_187860957871159253_1148
2013-10-31 20:36:06,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_187860957871159253_1148 src: /127.0.0.1:40364 dest: /127.0.0.1:46399
2013-10-31 20:36:06,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_187860957871159253_1148 src: /127.0.0.1:44657 dest: /127.0.0.1:33202
2013-10-31 20:36:06,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_187860957871159253_1148 src: /127.0.0.1:34876 dest: /127.0.0.1:37249
2013-10-31 20:36:06,222 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34876, dest: /127.0.0.1:37249, bytes: 16923, op: HDFS_WRITE, cliID: DFSClient_358193244, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_187860957871159253_1148, duration: 6436107
2013-10-31 20:36:06,222 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_187860957871159253_1148 terminating
2013-10-31 20:36:06,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44657, dest: /127.0.0.1:33202, bytes: 16923, op: HDFS_WRITE, cliID: DFSClient_358193244, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_187860957871159253_1148, duration: 4260638
2013-10-31 20:36:06,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_187860957871159253_1148 terminating
2013-10-31 20:36:06,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40364, dest: /127.0.0.1:46399, bytes: 16923, op: HDFS_WRITE, cliID: DFSClient_358193244, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_187860957871159253_1148, duration: 7022115
2013-10-31 20:36:06,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_187860957871159253_1148 terminating
2013-10-31 20:36:06,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_187860957871159253_1148 size 16923
2013-10-31 20:36:06,229 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_1383251735308_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F0D1910A6F0A0478F from client DFSClient_358193244
2013-10-31 20:36:06,229 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_logs/history/job_20131031202710049_0016_1383251735308_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F0D1910A6F0A0478F is closed by DFSClient_358193244
2013-10-31 20:36:06,230 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_187860957871159253_1148 size 16923
2013-10-31 20:36:06,230 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_187860957871159253_1148 size 16923
2013-10-31 20:36:06,236 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0016_1383251735308_hadoop_%5B3BBD4688B05646BFB8DEE6C5EED71EB6%2F0D1910A6F0A0478F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:36:06,237 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0016_m_000000_0'
2013-10-31 20:36:06,237 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0016_m_000001_0'
2013-10-31 20:36:06,237 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0016_m_000002_0'
2013-10-31 20:36:06,238 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0016_r_000000_0'
2013-10-31 20:36:06,239 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2487173678132909357 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:06,239 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2487173678132909357 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:06,239 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2487173678132909357 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:06,242 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0016_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:36:06,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0016 dst=null perm=null
2013-10-31 20:36:06,247 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023806889262409912 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:06,247 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023806889262409912 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:06,247 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023806889262409912 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:06,247 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6215904457775077827 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:06,248 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6215904457775077827 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:06,248 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6215904457775077827 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:06,248 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5191893024991787107 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:06,248 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5191893024991787107 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:06,248 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5191893024991787107 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:06,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8420233026_lower_upper_BB2ECCC0AE7E401C95CC78714D1949A8 dst=null perm=null
2013-10-31 20:36:06,256 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/_temporary
2013-10-31 20:36:06,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false dst=null perm=null
2013-10-31 20:36:06,277 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:36:06,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:36:06,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:36:06,282 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40368, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-478630356935697483_1147, duration: 366709
2013-10-31 20:36:06,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false dst=null perm=null
2013-10-31 20:36:06,291 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:36:06,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:36:06,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:36:06,295 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34879, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-478630356935697483_1147, duration: 430689
2013-10-31 20:36:06,296 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false
2013-10-31 20:36:06,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false dst=null perm=null
2013-10-31 20:36:06,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/true/false/false/part-00000 dst=null perm=null
2013-10-31 20:36:06,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34880, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-478630356935697483_1147, duration: 382764
2013-10-31 20:36:06,312 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:36:06,312 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:36:06,325 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 20:36:06,325 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 20:36:06,325 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["SequenceFile[[UNKNOWN]->['bytes', 'count']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes"]
2013-10-31 20:36:06,326 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 20:36:06,326 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 20:36:06,326 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 20:36:06,327 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...ipesplatform/grouponbytes
2013-10-31 20:36:06,331 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 20:36:06,331 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:36:06,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:06,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:36:06,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7954676720405413274_1141 file build/test/data/dfs/data/data3/current/blk_-7954676720405413274 for deletion
2013-10-31 20:36:06,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1432510737412584353_1143 file build/test/data/dfs/data/data3/current/blk_-1432510737412584353 for deletion
2013-10-31 20:36:06,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7954676720405413274_1141 at file build/test/data/dfs/data/data3/current/blk_-7954676720405413274
2013-10-31 20:36:06,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4078679559254430485_1140 file build/test/data/dfs/data/data4/current/blk_4078679559254430485 for deletion
2013-10-31 20:36:06,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1432510737412584353_1143 at file build/test/data/dfs/data/data3/current/blk_-1432510737412584353
2013-10-31 20:36:06,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7156624117710656062_1142 file build/test/data/dfs/data/data4/current/blk_7156624117710656062 for deletion
2013-10-31 20:36:06,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4078679559254430485_1140 at file build/test/data/dfs/data/data4/current/blk_4078679559254430485
2013-10-31 20:36:06,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7156624117710656062_1142 at file build/test/data/dfs/data/data4/current/blk_7156624117710656062
2013-10-31 20:36:06,415 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0016
2013-10-31 20:36:06,415 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0016 being deleted.
2013-10-31 20:36:06,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,483 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar. blk_-3584747716999234662_1149
2013-10-31 20:36:06,484 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3584747716999234662_1149 src: /127.0.0.1:36277 dest: /127.0.0.1:49827
2013-10-31 20:36:06,486 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3584747716999234662_1149 src: /127.0.0.1:40372 dest: /127.0.0.1:46399
2013-10-31 20:36:06,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3584747716999234662_1149 src: /127.0.0.1:44665 dest: /127.0.0.1:33202
2013-10-31 20:36:06,498 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44665, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3584747716999234662_1149, duration: 4557841
2013-10-31 20:36:06,498 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3584747716999234662_1149 terminating
2013-10-31 20:36:06,500 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40372, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3584747716999234662_1149, duration: 6293156
2013-10-31 20:36:06,500 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3584747716999234662_1149 terminating
2013-10-31 20:36:06,501 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36277, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3584747716999234662_1149, duration: 8129947
2013-10-31 20:36:06,502 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3584747716999234662_1149 size 238055
2013-10-31 20:36:06,502 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3584747716999234662_1149 terminating
2013-10-31 20:36:06,504 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-3584747716999234662_1149 size 238055
2013-10-31 20:36:06,504 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar from client DFSClient_848976415
2013-10-31 20:36:06,505 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar is closed by DFSClient_848976415
2013-10-31 20:36:06,506 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-3584747716999234662_1149 size 238055
2013-10-31 20:36:06,512 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar. New replication is 10
2013-10-31 20:36:06,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=null
2013-10-31 20:36:06,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,521 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:36:06,527 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:36:06,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:36:06,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,544 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split. New replication is 10
2013-10-31 20:36:06,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=null
2013-10-31 20:36:06,552 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split. blk_-2471405387911211681_1150
2013-10-31 20:36:06,554 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2471405387911211681_1150 src: /127.0.0.1:44666 dest: /127.0.0.1:33202
2013-10-31 20:36:06,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2471405387911211681_1150 src: /127.0.0.1:34885 dest: /127.0.0.1:37249
2013-10-31 20:36:06,557 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2471405387911211681_1150 src: /127.0.0.1:36282 dest: /127.0.0.1:49827
2013-10-31 20:36:06,559 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2471405387911211681_1150 src: /127.0.0.1:40377 dest: /127.0.0.1:46399
2013-10-31 20:36:06,563 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40377, dest: /127.0.0.1:46399, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2471405387911211681_1150, duration: 835583
2013-10-31 20:36:06,563 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2471405387911211681_1150 terminating
2013-10-31 20:36:06,564 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36282, dest: /127.0.0.1:49827, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2471405387911211681_1150, duration: 2292232
2013-10-31 20:36:06,564 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2471405387911211681_1150 terminating
2013-10-31 20:36:06,565 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-2471405387911211681_1150 size 1403
2013-10-31 20:36:06,566 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34885, dest: /127.0.0.1:37249, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-2471405387911211681_1150, duration: 4079172
2013-10-31 20:36:06,566 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2471405387911211681_1150 terminating
2013-10-31 20:36:06,568 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44666, dest: /127.0.0.1:33202, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-2471405387911211681_1150, duration: 5816983
2013-10-31 20:36:06,568 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-2471405387911211681_1150 size 1403
2013-10-31 20:36:06,568 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2471405387911211681_1150 terminating
2013-10-31 20:36:06,570 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-2471405387911211681_1150 size 1403
2013-10-31 20:36:06,570 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split from client DFSClient_848976415
2013-10-31 20:36:06,571 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split is closed by DFSClient_848976415
2013-10-31 20:36:06,571 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-2471405387911211681_1150 size 1403
2013-10-31 20:36:06,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,589 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.splitmetainfo. blk_7633397748358418475_1151
2013-10-31 20:36:06,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633397748358418475_1151 src: /127.0.0.1:44670 dest: /127.0.0.1:33202
2013-10-31 20:36:06,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633397748358418475_1151 src: /127.0.0.1:40379 dest: /127.0.0.1:46399
2013-10-31 20:36:06,594 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633397748358418475_1151 src: /127.0.0.1:34890 dest: /127.0.0.1:37249
2013-10-31 20:36:06,598 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34890, dest: /127.0.0.1:37249, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7633397748358418475_1151, duration: 769431
2013-10-31 20:36:06,598 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7633397748358418475_1151 terminating
2013-10-31 20:36:06,599 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40379, dest: /127.0.0.1:46399, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_7633397748358418475_1151, duration: 2478010
2013-10-31 20:36:06,600 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7633397748358418475_1151 terminating
2013-10-31 20:36:06,601 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44670, dest: /127.0.0.1:33202, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7633397748358418475_1151, duration: 4202408
2013-10-31 20:36:06,602 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7633397748358418475_1151 terminating
2013-10-31 20:36:06,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_7633397748358418475_1151 size 156
2013-10-31 20:36:06,604 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:36:06,604 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:36:06,604 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7633397748358418475_1151 size 156
2013-10-31 20:36:06,605 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7633397748358418475_1151 size 156
2013-10-31 20:36:06,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,624 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml. blk_-8539299561913017447_1152
2013-10-31 20:36:06,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8539299561913017447_1152 src: /127.0.0.1:36287 dest: /127.0.0.1:49827
2013-10-31 20:36:06,628 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8539299561913017447_1152 src: /127.0.0.1:40382 dest: /127.0.0.1:46399
2013-10-31 20:36:06,629 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8539299561913017447_1152 src: /127.0.0.1:34893 dest: /127.0.0.1:37249
2013-10-31 20:36:06,633 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34893, dest: /127.0.0.1:37249, bytes: 28798, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8539299561913017447_1152, duration: 1404516
2013-10-31 20:36:06,634 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8539299561913017447_1152 terminating
2013-10-31 20:36:06,635 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40382, dest: /127.0.0.1:46399, bytes: 28798, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8539299561913017447_1152, duration: 3138329
2013-10-31 20:36:06,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8539299561913017447_1152 terminating
2013-10-31 20:36:06,637 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36287, dest: /127.0.0.1:49827, bytes: 28798, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8539299561913017447_1152, duration: 4766051
2013-10-31 20:36:06,637 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8539299561913017447_1152 terminating
2013-10-31 20:36:06,639 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-8539299561913017447_1152 size 28798
2013-10-31 20:36:06,640 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-8539299561913017447_1152 size 28798
2013-10-31 20:36:06,640 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml from client DFSClient_848976415
2013-10-31 20:36:06,641 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml is closed by DFSClient_848976415
2013-10-31 20:36:06,641 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-8539299561913017447_1152 size 28798
2013-10-31 20:36:06,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=null
2013-10-31 20:36:06,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34895, bytes: 29026, op: HDFS_READ, cliID: DFSClient_-572401212, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-8539299561913017447_1152, duration: 383840
2013-10-31 20:36:06,673 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0016
2013-10-31 20:36:06,673 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0016 being deleted.
2013-10-31 20:36:06,675 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0017: nMaps=4 nReduces=1 max=-1
2013-10-31 20:36:06,676 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0017 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:36:06,676 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0017
2013-10-31 20:36:06,676 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0017 RESULT=SUCCESS
2013-10-31 20:36:06,676 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0017
2013-10-31 20:36:06,678 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031202710049_0017
2013-10-31 20:36:06,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_1383251766645_hadoop_%5B1F6B1C1C54654D9A992B8532C84D4561%2F600AE7AA114047C2 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:06,708 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_conf.xml. blk_8995486848551488042_1154
2013-10-31 20:36:06,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8995486848551488042_1154 src: /127.0.0.1:34896 dest: /127.0.0.1:37249
2013-10-31 20:36:06,711 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8995486848551488042_1154 src: /127.0.0.1:40387 dest: /127.0.0.1:46399
2013-10-31 20:36:06,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8995486848551488042_1154 src: /127.0.0.1:36294 dest: /127.0.0.1:49827
2013-10-31 20:36:06,725 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36294, dest: /127.0.0.1:49827, bytes: 28863, op: HDFS_WRITE, cliID: DFSClient_-572401212, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8995486848551488042_1154, duration: 11878646
2013-10-31 20:36:06,726 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8995486848551488042_1154 terminating
2013-10-31 20:36:06,728 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40387, dest: /127.0.0.1:46399, bytes: 28863, op: HDFS_WRITE, cliID: DFSClient_-572401212, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8995486848551488042_1154, duration: 5122794
2013-10-31 20:36:06,729 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8995486848551488042_1154 terminating
2013-10-31 20:36:06,732 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8995486848551488042_1154 size 28863
2013-10-31 20:36:06,732 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34896, dest: /127.0.0.1:37249, bytes: 28863, op: HDFS_WRITE, cliID: DFSClient_-572401212, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_8995486848551488042_1154, duration: 8217067
2013-10-31 20:36:06,733 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8995486848551488042_1154 size 28863
2013-10-31 20:36:06,733 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8995486848551488042_1154 terminating
2013-10-31 20:36:06,736 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_8995486848551488042_1154 size 28863
2013-10-31 20:36:06,739 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_conf.xml from client DFSClient_-572401212
2013-10-31 20:36:06,739 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_conf.xml is closed by DFSClient_-572401212
2013-10-31 20:36:07,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:07,139 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken. blk_6286107620319586138_1155
2013-10-31 20:36:07,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6286107620319586138_1155 src: /127.0.0.1:36295 dest: /127.0.0.1:49827
2013-10-31 20:36:07,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6286107620319586138_1155 src: /127.0.0.1:44682 dest: /127.0.0.1:33202
2013-10-31 20:36:07,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6286107620319586138_1155 src: /127.0.0.1:34901 dest: /127.0.0.1:37249
2013-10-31 20:36:07,148 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34901, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6286107620319586138_1155, duration: 2315950
2013-10-31 20:36:07,148 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6286107620319586138_1155 terminating
2013-10-31 20:36:07,148 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44682, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6286107620319586138_1155, duration: 3241121
2013-10-31 20:36:07,149 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6286107620319586138_1155 terminating
2013-10-31 20:36:07,149 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36295, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6286107620319586138_1155, duration: 3639544
2013-10-31 20:36:07,149 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6286107620319586138_1155 terminating
2013-10-31 20:36:07,152 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_6286107620319586138_1155 size 116
2013-10-31 20:36:07,153 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken from client DFSClient_848976415
2013-10-31 20:36:07,153 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken is closed by DFSClient_848976415
2013-10-31 20:36:07,153 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_6286107620319586138_1155 size 116
2013-10-31 20:36:07,153 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_6286107620319586138_1155 size 116
2013-10-31 20:36:07,159 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken
2013-10-31 20:36:07,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.splitmetainfo dst=null perm=null
2013-10-31 20:36:07,164 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44684, bytes: 160, op: HDFS_READ, cliID: DFSClient_-572401212, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7633397748358418475_1151, duration: 188093
2013-10-31 20:36:07,165 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0017 = 1449. Number of splits = 4
2013-10-31 20:36:07,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:07,169 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0017 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:36:07,169 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0017 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 20:36:07,489 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:33202 to replicate blk_-3584747716999234662_1149 to datanode(s) 127.0.0.1:37249
2013-10-31 20:36:07,489 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-6215904457775077827_1136 blk_-2487173678132909357_1146 blk_5191893024991787107_1138
2013-10-31 20:36:07,489 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-2487173678132909357_1146 blk_5191893024991787107_1138 blk_3023806889262409912_1139
2013-10-31 20:36:07,920 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0017_m_000005_0' to tip task_20131031202710049_0017_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:36:07,927 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_m_000005_0 task's state:UNASSIGNED
2013-10-31 20:36:07,927 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_m_000005_0 which needs 1 slots
2013-10-31 20:36:07,927 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0016
2013-10-31 20:36:07,927 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_m_000005_0 which needs 1 slots
2013-10-31 20:36:07,928 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0016 being deleted.
2013-10-31 20:36:07,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken dst=null perm=null
2013-10-31 20:36:07,937 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34903, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_6286107620319586138_1155, duration: 276649
2013-10-31 20:36:07,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=null
2013-10-31 20:36:07,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40395, bytes: 29026, op: HDFS_READ, cliID: DFSClient_1858052085, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8539299561913017447_1152, duration: 441469
2013-10-31 20:36:07,981 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:36:08,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=null
2013-10-31 20:36:08,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36302, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1858052085, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3584747716999234662_1149, duration: 1505531
2013-10-31 20:36:08,046 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:36:08,053 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:36:08,059 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:36:08,065 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:36:08,070 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:36:08,077 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:36:08,083 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:36:08,083 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:36:08,126 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0017_m_429120515
2013-10-31 20:36:08,127 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0017_m_429120515 spawned.
2013-10-31 20:36:08,129 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0017/attempt_20131031202710049_0017_m_000005_0/taskjvm.sh
2013-10-31 20:36:08,733 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_5471784388218150662_1037
2013-10-31 20:36:09,333 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_m_429120515 given task: attempt_20131031202710049_0017_m_000005_0
2013-10-31 20:36:09,358 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909) Starting thread to transfer block blk_-3584747716999234662_1149 to 127.0.0.1:37249
2013-10-31 20:36:09,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3584747716999234662_1149 src: /127.0.0.1:34908 dest: /127.0.0.1:37249
2013-10-31 20:36:09,360 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909):Transmitted block blk_-3584747716999234662_1149 to /127.0.0.1:37249
2013-10-31 20:36:09,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3584747716999234662_1149 src: /127.0.0.1:34908 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:36:09,367 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3584747716999234662_1149 size 238055
2013-10-31 20:36:09,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6215904457775077827_1136 file build/test/data/dfs/data/data6/current/blk_-6215904457775077827 for deletion
2013-10-31 20:36:09,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2487173678132909357_1146 file build/test/data/dfs/data/data6/current/blk_-2487173678132909357 for deletion
2013-10-31 20:36:09,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6215904457775077827_1136 at file build/test/data/dfs/data/data6/current/blk_-6215904457775077827
2013-10-31 20:36:09,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5191893024991787107_1138 file build/test/data/dfs/data/data6/current/blk_5191893024991787107 for deletion
2013-10-31 20:36:09,803 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2487173678132909357_1146 at file build/test/data/dfs/data/data6/current/blk_-2487173678132909357
2013-10-31 20:36:09,803 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5191893024991787107_1138 at file build/test/data/dfs/data/data6/current/blk_5191893024991787107
2013-10-31 20:36:09,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:10,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2487173678132909357_1146 file build/test/data/dfs/data/data7/current/blk_-2487173678132909357 for deletion
2013-10-31 20:36:10,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023806889262409912_1139 file build/test/data/dfs/data/data7/current/blk_3023806889262409912 for deletion
2013-10-31 20:36:10,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2487173678132909357_1146 at file build/test/data/dfs/data/data7/current/blk_-2487173678132909357
2013-10-31 20:36:10,194 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5191893024991787107_1138 file build/test/data/dfs/data/data8/current/blk_5191893024991787107 for deletion
2013-10-31 20:36:10,194 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023806889262409912_1139 at file build/test/data/dfs/data/data7/current/blk_3023806889262409912
2013-10-31 20:36:10,194 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5191893024991787107_1138 at file build/test/data/dfs/data/data8/current/blk_5191893024991787107
2013-10-31 20:36:10,490 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_-6215904457775077827_1136 blk_5191893024991787107_1138 blk_3023806889262409912_1139
2013-10-31 20:36:10,490 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-6215904457775077827_1136 blk_-2487173678132909357_1146 blk_3023806889262409912_1139
2013-10-31 20:36:11,239 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0016
2013-10-31 20:36:11,240 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0016_m_000001_0 not found in cache
2013-10-31 20:36:11,241 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0016 for user-log deletion with retainTimeStamp:1383338171241
2013-10-31 20:36:11,912 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6215904457775077827_1136 file build/test/data/dfs/data/data1/current/blk_-6215904457775077827 for deletion
2013-10-31 20:36:11,912 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2487173678132909357_1146 file build/test/data/dfs/data/data1/current/blk_-2487173678132909357 for deletion
2013-10-31 20:36:11,912 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6215904457775077827_1136 at file build/test/data/dfs/data/data1/current/blk_-6215904457775077827
2013-10-31 20:36:11,912 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023806889262409912_1139 file build/test/data/dfs/data/data1/current/blk_3023806889262409912 for deletion
2013-10-31 20:36:11,913 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2487173678132909357_1146 at file build/test/data/dfs/data/data1/current/blk_-2487173678132909357
2013-10-31 20:36:11,913 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023806889262409912_1139 at file build/test/data/dfs/data/data1/current/blk_3023806889262409912
2013-10-31 20:36:12,175 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0016_m_2127242113 since job job_20131031202710049_0016 is dead
2013-10-31 20:36:12,186 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group404 with signal TERM. Exit code 0
2013-10-31 20:36:12,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6215904457775077827_1136 file build/test/data/dfs/data/data4/current/blk_-6215904457775077827 for deletion
2013-10-31 20:36:12,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023806889262409912_1139 file build/test/data/dfs/data/data4/current/blk_3023806889262409912 for deletion
2013-10-31 20:36:12,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6215904457775077827_1136 at file build/test/data/dfs/data/data4/current/blk_-6215904457775077827
2013-10-31 20:36:12,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5191893024991787107_1138 file build/test/data/dfs/data/data3/current/blk_5191893024991787107 for deletion
2013-10-31 20:36:12,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023806889262409912_1139 at file build/test/data/dfs/data/data4/current/blk_3023806889262409912
2013-10-31 20:36:12,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5191893024991787107_1138 at file build/test/data/dfs/data/data3/current/blk_5191893024991787107
2013-10-31 20:36:12,366 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:12,366 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:12,367 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:12,367 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0016_m_2127242113 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:36:12,539 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0016_m_-996315330 since job job_20131031202710049_0016 is dead
2013-10-31 20:36:12,549 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group526 with signal TERM. Exit code 0
2013-10-31 20:36:12,703 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0016_r_-1858196187 since job job_20131031202710049_0016 is dead
2013-10-31 20:36:12,708 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group596 with signal TERM. Exit code 0
2013-10-31 20:36:12,756 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:12,756 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:12,756 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:12,756 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0016_m_-996315330 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:12,760 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000005_0 0.0% setup
2013-10-31 20:36:12,762 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_m_000005_0 is done.
2013-10-31 20:36:12,762 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_m_000005_0 was -1
2013-10-31 20:36:12,762 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:12,860 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:12,861 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:12,861 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:12,861 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0016_r_-1858196187 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:13,010 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 5
2013-10-31 20:36:13,933 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_m_000005_0' has completed task_20131031202710049_0017_m_000005 successfully.
2013-10-31 20:36:14,228 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0017_m_000000_0' to tip task_20131031202710049_0017_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:36:14,229 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0017_m_000000
2013-10-31 20:36:14,231 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:36:14,231 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_m_000000_0 which needs 1 slots
2013-10-31 20:36:14,231 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_m_000000_0 which needs 1 slots
2013-10-31 20:36:14,466 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0017_m_-652891250
2013-10-31 20:36:14,468 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0017_m_-652891250 spawned.
2013-10-31 20:36:14,471 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0017/attempt_20131031202710049_0017_m_000000_0/taskjvm.sh
2013-10-31 20:36:15,245 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0017_m_000001_0' to tip task_20131031202710049_0017_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:36:15,246 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0017_m_000001
2013-10-31 20:36:15,246 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:36:15,246 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_m_000001_0 which needs 1 slots
2013-10-31 20:36:15,247 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_m_000001_0 which needs 1 slots
2013-10-31 20:36:15,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken dst=null perm=null
2013-10-31 20:36:15,251 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36306, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_6286107620319586138_1155, duration: 137387
2013-10-31 20:36:15,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=null
2013-10-31 20:36:15,255 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40402, bytes: 29026, op: HDFS_READ, cliID: DFSClient_-164886386, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8539299561913017447_1152, duration: 150301
2013-10-31 20:36:15,268 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:36:15,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=null
2013-10-31 20:36:15,283 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40403, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-164886386, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3584747716999234662_1149, duration: 676333
2013-10-31 20:36:15,334 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0017_m_-1394926320
2013-10-31 20:36:15,335 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0017_m_-1394926320 spawned.
2013-10-31 20:36:15,336 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0017/attempt_20131031202710049_0017_m_000001_0/taskjvm.sh
2013-10-31 20:36:15,422 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0017_m_000002_0' to tip task_20131031202710049_0017_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:36:15,422 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0017_m_000002
2013-10-31 20:36:15,423 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:36:15,423 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_m_000002_0 which needs 1 slots
2013-10-31 20:36:15,424 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_m_000002_0 which needs 1 slots
2013-10-31 20:36:15,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken dst=null perm=null
2013-10-31 20:36:15,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44696, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6286107620319586138_1155, duration: 153853
2013-10-31 20:36:15,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=null
2013-10-31 20:36:15,434 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36312, bytes: 29026, op: HDFS_READ, cliID: DFSClient_-1231696946, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-8539299561913017447_1152, duration: 190508
2013-10-31 20:36:15,447 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:36:15,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=null
2013-10-31 20:36:15,462 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40407, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1231696946, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3584747716999234662_1149, duration: 627175
2013-10-31 20:36:15,666 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_m_-652891250 given task: attempt_20131031202710049_0017_m_000000_0
2013-10-31 20:36:15,677 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0017_m_000003_0' to tip task_20131031202710049_0017_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:36:15,678 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0017_m_000003
2013-10-31 20:36:15,680 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:36:15,680 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_m_000003_0 which needs 1 slots
2013-10-31 20:36:15,680 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_m_000003_0 which needs 1 slots
2013-10-31 20:36:15,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017/jobToken dst=null perm=null
2013-10-31 20:36:15,685 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44701, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_6286107620319586138_1155, duration: 205313
2013-10-31 20:36:15,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.xml dst=null perm=null
2013-10-31 20:36:15,694 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40411, bytes: 29026, op: HDFS_READ, cliID: DFSClient_110614431, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-8539299561913017447_1152, duration: 261047
2013-10-31 20:36:15,707 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:36:15,711 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0017_m_-1487284786
2013-10-31 20:36:15,711 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0017_m_-1487284786 spawned.
2013-10-31 20:36:15,713 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0017/attempt_20131031202710049_0017_m_000002_0/taskjvm.sh
2013-10-31 20:36:15,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.jar dst=null perm=null
2013-10-31 20:36:15,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44704, bytes: 239915, op: HDFS_READ, cliID: DFSClient_110614431, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3584747716999234662_1149, duration: 647512
2013-10-31 20:36:16,209 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0017_m_1227799006
2013-10-31 20:36:16,210 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0017_m_1227799006 spawned.
2013-10-31 20:36:16,211 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0017/attempt_20131031202710049_0017_m_000003_0/taskjvm.sh
2013-10-31 20:36:16,530 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_m_-1394926320 given task: attempt_20131031202710049_0017_m_000001_0
2013-10-31 20:36:16,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=null
2013-10-31 20:36:16,542 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36321, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-2471405387911211681_1150, duration: 166044
2013-10-31 20:36:16,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:36:16,582 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34926, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000000_0, offset: 1024, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3037311813710157570_1002, duration: 125647
2013-10-31 20:36:16,998 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_m_-1487284786 given task: attempt_20131031202710049_0017_m_000002_0
2013-10-31 20:36:17,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=null
2013-10-31 20:36:17,021 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40419, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000001_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2471405387911211681_1150, duration: 169109
2013-10-31 20:36:17,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:36:17,291 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_m_1227799006 given task: attempt_20131031202710049_0017_m_000003_0
2013-10-31 20:36:17,317 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44713, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3037311813710157570_1002, duration: 175452
2013-10-31 20:36:17,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=null
2013-10-31 20:36:17,493 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40423, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000002_0, offset: 512, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-2471405387911211681_1150, duration: 168597
2013-10-31 20:36:17,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:36:17,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34934, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000002_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3037311813710157570_1002, duration: 155741
2013-10-31 20:36:17,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017/job.split dst=null perm=null
2013-10-31 20:36:17,788 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44718, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000003_0, offset: 1024, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-2471405387911211681_1150, duration: 123761
2013-10-31 20:36:17,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 20:36:17,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34937, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0017_m_000003_0, offset: 512, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3037311813710157570_1002, duration: 144490
2013-10-31 20:36:19,231 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0017_m_000005_0
2013-10-31 20:36:19,232 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0017_m_000005_0
2013-10-31 20:36:19,232 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0017_m_000005_0 not found in cache
2013-10-31 20:36:19,465 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 20:36:19,467 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_m_000000_0 is done.
2013-10-31 20:36:19,468 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_m_000000_0 was 126
2013-10-31 20:36:19,468 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:19,951 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 20:36:19,954 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_m_000001_0 is done.
2013-10-31 20:36:19,954 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_m_000001_0 was 182
2013-10-31 20:36:19,955 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:20,236 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_m_000000_0' has completed task_20131031202710049_0017_m_000000 successfully.
2013-10-31 20:36:20,238 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0017_r_000000_0' to tip task_20131031202710049_0017_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:36:20,240 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:36:20,241 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_r_000000_0 which needs 1 slots
2013-10-31 20:36:20,241 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_r_000000_0 which needs 1 slots
2013-10-31 20:36:20,280 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0017_r_699960213
2013-10-31 20:36:20,281 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0017_r_699960213 spawned.
2013-10-31 20:36:20,283 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0017/attempt_20131031202710049_0017_r_000000_0/taskjvm.sh
2013-10-31 20:36:20,425 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000002_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 20:36:20,427 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_m_000002_0 is done.
2013-10-31 20:36:20,427 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_m_000002_0 was 181
2013-10-31 20:36:20,427 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:20,712 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000003_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 20:36:20,713 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_m_000003_0 is done.
2013-10-31 20:36:20,713 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_m_000003_0 was 125
2013-10-31 20:36:20,713 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:21,249 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_r_699960213 given task: attempt_20131031202710049_0017_r_000000_0
2013-10-31 20:36:21,253 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_m_000001_0' has completed task_20131031202710049_0017_m_000001 successfully.
2013-10-31 20:36:21,429 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_m_000002_0' has completed task_20131031202710049_0017_m_000002 successfully.
2013-10-31 20:36:21,685 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_m_000003_0' has completed task_20131031202710049_0017_m_000003 successfully.
2013-10-31 20:36:26,933 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53607, bytes: 126, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0017_m_000000_0, duration: 9529337
2013-10-31 20:36:26,956 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:53982, bytes: 182, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0017_m_000001_0, duration: 12704366
2013-10-31 20:36:26,974 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:54275, bytes: 181, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0017_m_000002_0, duration: 13146918
2013-10-31 20:36:26,994 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:46006, bytes: 125, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0017_m_000003_0, duration: 13159026
2013-10-31 20:36:27,742 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:36:27,799 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:36:27,874 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:36:28,055 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 822 Total time for transactions(ms): 18Number of transactions batched in Syncs: 28 Number of syncs: 568 SyncTimes(ms): 10889 2503
2013-10-31 20:36:28,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:28,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:28,097 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0/part-00000. blk_5053067102702086438_1156
2013-10-31 20:36:28,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5053067102702086438_1156 src: /127.0.0.1:44727 dest: /127.0.0.1:33202
2013-10-31 20:36:28,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5053067102702086438_1156 src: /127.0.0.1:34946 dest: /127.0.0.1:37249
2013-10-31 20:36:28,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5053067102702086438_1156 src: /127.0.0.1:40437 dest: /127.0.0.1:46399
2013-10-31 20:36:28,149 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40437, dest: /127.0.0.1:46399, bytes: 550, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0017_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5053067102702086438_1156, duration: 3676032
2013-10-31 20:36:28,149 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5053067102702086438_1156 terminating
2013-10-31 20:36:28,150 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34946, dest: /127.0.0.1:37249, bytes: 550, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0017_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_5053067102702086438_1156, duration: 5818541
2013-10-31 20:36:28,151 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5053067102702086438_1156 terminating
2013-10-31 20:36:28,153 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44727, dest: /127.0.0.1:33202, bytes: 550, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0017_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5053067102702086438_1156, duration: 7232570
2013-10-31 20:36:28,154 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_5053067102702086438_1156 size 550
2013-10-31 20:36:28,154 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5053067102702086438_1156 terminating
2013-10-31 20:36:28,155 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5053067102702086438_1156 size 550
2013-10-31 20:36:28,157 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5053067102702086438_1156 size 550
2013-10-31 20:36:28,158 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0017_r_000000_0
2013-10-31 20:36:28,159 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0017_r_000000_0
2013-10-31 20:36:28,195 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0017_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:36:28,196 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 20:36:29,251 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031202710049_0017_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:36:29,252 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0017_r_000000_0
2013-10-31 20:36:30,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0 dst=null perm=null
2013-10-31 20:36:30,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:30,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:30,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary/_attempt_20131031202710049_0017_r_000000_0 dst=null perm=null
2013-10-31 20:36:30,795 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_r_000000_0 1.0% reduce > reduce
2013-10-31 20:36:30,798 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_r_000000_0 1.0% reduce > reduce
2013-10-31 20:36:30,799 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_r_000000_0 is done.
2013-10-31 20:36:30,799 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_r_000000_0 was -1
2013-10-31 20:36:30,800 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:32,256 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_r_000000_0' has completed task_20131031202710049_0017_r_000000 successfully.
2013-10-31 20:36:32,260 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0017_m_000004_0' to tip task_20131031202710049_0017_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:36:32,263 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0017_m_000004_0 task's state:UNASSIGNED
2013-10-31 20:36:32,263 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0017_m_000004_0 which needs 1 slots
2013-10-31 20:36:32,263 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0017_m_000004_0 which needs 1 slots
2013-10-31 20:36:32,302 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0017/attempt_20131031202710049_0017_m_000004_0. Attempting to reuse: jvm_20131031202710049_0017_m_429120515
2013-10-31 20:36:32,816 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0017_m_429120515 given task: attempt_20131031202710049_0017_m_000004_0
2013-10-31 20:36:32,925 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000004_0 0.0%
2013-10-31 20:36:32,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary dst=null perm=null
2013-10-31 20:36:32,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:32,948 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_SUCCESS from client DFSClient_attempt_20131031202710049_0017_m_000004_0
2013-10-31 20:36:32,948 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0017_m_000004_0
2013-10-31 20:36:32,954 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3584747716999234662 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:32,954 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3584747716999234662 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:32,954 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3584747716999234662 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:32,954 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3584747716999234662 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:32,954 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2471405387911211681 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2471405387911211681 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2471405387911211681 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2471405387911211681 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633397748358418475 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633397748358418475 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633397748358418475 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8539299561913017447 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8539299561913017447 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:36:32,955 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8539299561913017447 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:32,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0017 dst=null perm=null
2013-10-31 20:36:34,494 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_7633397748358418475_1151 blk_-2471405387911211681_1150 blk_-8539299561913017447_1152 blk_-3584747716999234662_1149
2013-10-31 20:36:34,495 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_7633397748358418475_1151 blk_-2471405387911211681_1150 blk_-8539299561913017447_1152 blk_-3584747716999234662_1149
2013-10-31 20:36:35,894 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0017_m_000004_0 0.0% cleanup
2013-10-31 20:36:35,896 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0017_m_000004_0 is done.
2013-10-31 20:36:35,896 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0017_m_000004_0 was -1
2013-10-31 20:36:35,896 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8539299561913017447_1152 file build/test/data/dfs/data/data2/current/blk_-8539299561913017447 for deletion
2013-10-31 20:36:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3584747716999234662_1149 file build/test/data/dfs/data/data1/current/blk_-3584747716999234662 for deletion
2013-10-31 20:36:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2471405387911211681_1150 file build/test/data/dfs/data/data2/current/blk_-2471405387911211681 for deletion
2013-10-31 20:36:35,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633397748358418475_1151 file build/test/data/dfs/data/data1/current/blk_7633397748358418475 for deletion
2013-10-31 20:36:36,012 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8539299561913017447_1152 at file build/test/data/dfs/data/data2/current/blk_-8539299561913017447
2013-10-31 20:36:36,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3584747716999234662_1149 at file build/test/data/dfs/data/data1/current/blk_-3584747716999234662
2013-10-31 20:36:36,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2471405387911211681_1150 at file build/test/data/dfs/data/data2/current/blk_-2471405387911211681
2013-10-31 20:36:36,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633397748358418475_1151 at file build/test/data/dfs/data/data1/current/blk_7633397748358418475
2013-10-31 20:36:36,812 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8539299561913017447_1152 file build/test/data/dfs/data/data6/current/blk_-8539299561913017447 for deletion
2013-10-31 20:36:36,812 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3584747716999234662_1149 file build/test/data/dfs/data/data5/current/blk_-3584747716999234662 for deletion
2013-10-31 20:36:36,812 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8539299561913017447_1152 at file build/test/data/dfs/data/data6/current/blk_-8539299561913017447
2013-10-31 20:36:36,812 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2471405387911211681_1150 file build/test/data/dfs/data/data6/current/blk_-2471405387911211681 for deletion
2013-10-31 20:36:36,813 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3584747716999234662_1149 at file build/test/data/dfs/data/data5/current/blk_-3584747716999234662
2013-10-31 20:36:36,813 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2471405387911211681_1150 at file build/test/data/dfs/data/data6/current/blk_-2471405387911211681
2013-10-31 20:36:36,813 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633397748358418475_1151 file build/test/data/dfs/data/data5/current/blk_7633397748358418475 for deletion
2013-10-31 20:36:36,814 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633397748358418475_1151 at file build/test/data/dfs/data/data5/current/blk_7633397748358418475
2013-10-31 20:36:37,263 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0017_r_000000_0
2013-10-31 20:36:37,264 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0017_r_000000_0
2013-10-31 20:36:37,495 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_-2471405387911211681_1150 blk_-8539299561913017447_1152 blk_-3584747716999234662_1149
2013-10-31 20:36:37,496 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_7633397748358418475_1151 blk_-2471405387911211681_1150 blk_-3584747716999234662_1149
2013-10-31 20:36:38,271 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0017_m_000004_0' has completed task_20131031202710049_0017_m_000004 successfully.
2013-10-31 20:36:38,272 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0017 has completed successfully.
2013-10-31 20:36:38,272 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0017,submitTime=1383251766645,launchTime=1383251767169,firstMapTaskLaunchTime=1383251774227,firstReduceTaskLaunchTime=1383251780237,firstJobSetupTaskLaunchTime=1383251767920,firstJobCleanupTaskLaunchTime=1383251792260,finishTime=1383251798272,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1F6B1C1C54654D9A992B8532C84D4561/600AE7AA114047C2BAECDAC65ADF9EF6] test/(1/1) ...ipesplatform/grouponbytes
2013-10-31 20:36:38,279 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_1383251766645_hadoop_%5B1F6B1C1C54654D9A992B8532C84D4561%2F600AE7AA114047C2. blk_-7384668450270311186_1157
2013-10-31 20:36:38,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7384668450270311186_1157 src: /127.0.0.1:36349 dest: /127.0.0.1:49827
2013-10-31 20:36:38,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7384668450270311186_1157 src: /127.0.0.1:34954 dest: /127.0.0.1:37249
2013-10-31 20:36:38,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7384668450270311186_1157 src: /127.0.0.1:44737 dest: /127.0.0.1:33202
2013-10-31 20:36:38,299 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44737, dest: /127.0.0.1:33202, bytes: 28335, op: HDFS_WRITE, cliID: DFSClient_-572401212, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-7384668450270311186_1157, duration: 9968436
2013-10-31 20:36:38,299 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7384668450270311186_1157 terminating
2013-10-31 20:36:38,300 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34954, dest: /127.0.0.1:37249, bytes: 28335, op: HDFS_WRITE, cliID: DFSClient_-572401212, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7384668450270311186_1157, duration: 9715215
2013-10-31 20:36:38,301 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7384668450270311186_1157 terminating
2013-10-31 20:36:38,302 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36349, dest: /127.0.0.1:49827, bytes: 28335, op: HDFS_WRITE, cliID: DFSClient_-572401212, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7384668450270311186_1157, duration: 9509028
2013-10-31 20:36:38,302 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7384668450270311186_1157 terminating
2013-10-31 20:36:38,306 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7384668450270311186_1157 size 28335
2013-10-31 20:36:38,306 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_1383251766645_hadoop_%5B1F6B1C1C54654D9A992B8532C84D4561%2F600AE7AA114047C2 from client DFSClient_-572401212
2013-10-31 20:36:38,307 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_logs/history/job_20131031202710049_0017_1383251766645_hadoop_%5B1F6B1C1C54654D9A992B8532C84D4561%2F600AE7AA114047C2 is closed by DFSClient_-572401212
2013-10-31 20:36:38,307 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7384668450270311186_1157 size 28335
2013-10-31 20:36:38,308 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7384668450270311186_1157 size 28335
2013-10-31 20:36:38,317 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0017_1383251766645_hadoop_%5B1F6B1C1C54654D9A992B8532C84D4561%2F600AE7AA114047C2 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:36:38,318 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_m_000000_0'
2013-10-31 20:36:38,318 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_m_000004_0'
2013-10-31 20:36:38,318 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_m_000005_0'
2013-10-31 20:36:38,319 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_r_000000_0'
2013-10-31 20:36:38,319 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6286107620319586138 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:36:38,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6286107620319586138 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:36:38,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6286107620319586138 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:36:38,323 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0017_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:36:38,327 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/_temporary
2013-10-31 20:36:38,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0017 dst=null perm=null
2013-10-31 20:36:38,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes dst=null perm=null
2013-10-31 20:36:38,384 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:36:38,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/part-00000 dst=null perm=null
2013-10-31 20:36:38,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/part-00000 dst=null perm=null
2013-10-31 20:36:38,390 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40447, bytes: 558, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5053067102702086438_1156, duration: 366930
2013-10-31 20:36:38,392 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/grouponbytes
2013-10-31 20:36:38,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes dst=null perm=null
2013-10-31 20:36:38,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/grouponbytes/part-00000 dst=null perm=null
2013-10-31 20:36:38,401 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44740, bytes: 558, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5053067102702086438_1156, duration: 367274
2013-10-31 20:36:38,421 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:36:38,421 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:36:38,441 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:36:38,442 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:36:38,442 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:36:38,443 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[['num', 'char', 'group', 'value', 'num2', 'char2', 'group2', 'value2']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true"]
2013-10-31 20:36:38,443 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:36:38,443 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 20:36:38,444 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 20:36:38,445 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2)
2013-10-31 20:36:38,449 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:36:38,449 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:36:38,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:38,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:36:38,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,473 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar. blk_-54307569641458215_1158
2013-10-31 20:36:38,474 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-54307569641458215_1158 src: /127.0.0.1:36355 dest: /127.0.0.1:49827
2013-10-31 20:36:38,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-54307569641458215_1158 src: /127.0.0.1:44742 dest: /127.0.0.1:33202
2013-10-31 20:36:38,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-54307569641458215_1158 src: /127.0.0.1:40451 dest: /127.0.0.1:46399
2013-10-31 20:36:38,489 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40451, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-54307569641458215_1158, duration: 8348721
2013-10-31 20:36:38,490 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-54307569641458215_1158 terminating
2013-10-31 20:36:38,491 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44742, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-54307569641458215_1158, duration: 9863216
2013-10-31 20:36:38,491 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-54307569641458215_1158 terminating
2013-10-31 20:36:38,493 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36355, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-54307569641458215_1158, duration: 11561321
2013-10-31 20:36:38,493 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-54307569641458215_1158 terminating
2013-10-31 20:36:38,496 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-54307569641458215_1158 size 238055
2013-10-31 20:36:38,497 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar from client DFSClient_848976415
2013-10-31 20:36:38,497 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar is closed by DFSClient_848976415
2013-10-31 20:36:38,497 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-54307569641458215_1158 size 238055
2013-10-31 20:36:38,498 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-54307569641458215_1158 size 238055
2013-10-31 20:36:38,503 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar. New replication is 10
2013-10-31 20:36:38,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar dst=null perm=null
2013-10-31 20:36:38,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,865 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:36:38,870 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:36:38,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:36:38,874 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:36:38,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:36:38,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,886 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split. New replication is 10
2013-10-31 20:36:38,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split dst=null perm=null
2013-10-31 20:36:38,892 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split. blk_-3002066176191991015_1159
2013-10-31 20:36:38,893 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002066176191991015_1159 src: /127.0.0.1:36358 dest: /127.0.0.1:49827
2013-10-31 20:36:38,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002066176191991015_1159 src: /127.0.0.1:40453 dest: /127.0.0.1:46399
2013-10-31 20:36:38,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002066176191991015_1159 src: /127.0.0.1:34964 dest: /127.0.0.1:37249
2013-10-31 20:36:38,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002066176191991015_1159 src: /127.0.0.1:44747 dest: /127.0.0.1:33202
2013-10-31 20:36:38,902 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44747, dest: /127.0.0.1:33202, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3002066176191991015_1159, duration: 835744
2013-10-31 20:36:38,903 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3002066176191991015_1159 terminating
2013-10-31 20:36:38,906 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34964, dest: /127.0.0.1:37249, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3002066176191991015_1159, duration: 2327701
2013-10-31 20:36:38,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3002066176191991015_1159 size 697
2013-10-31 20:36:38,907 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3002066176191991015_1159 terminating
2013-10-31 20:36:38,908 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40453, dest: /127.0.0.1:46399, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3002066176191991015_1159, duration: 6922679
2013-10-31 20:36:38,909 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3002066176191991015_1159 terminating
2013-10-31 20:36:38,910 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3002066176191991015_1159 size 697
2013-10-31 20:36:38,910 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36358, dest: /127.0.0.1:49827, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3002066176191991015_1159, duration: 8734929
2013-10-31 20:36:38,911 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-3002066176191991015_1159 size 697
2013-10-31 20:36:38,911 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3002066176191991015_1159 terminating
2013-10-31 20:36:38,914 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-3002066176191991015_1159 size 697
2013-10-31 20:36:38,915 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split from client DFSClient_848976415
2013-10-31 20:36:38,915 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split is closed by DFSClient_848976415
2013-10-31 20:36:38,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,933 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.splitmetainfo. blk_2595148786846449360_1160
2013-10-31 20:36:38,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2595148786846449360_1160 src: /127.0.0.1:36362 dest: /127.0.0.1:49827
2013-10-31 20:36:38,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2595148786846449360_1160 src: /127.0.0.1:44749 dest: /127.0.0.1:33202
2013-10-31 20:36:38,938 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2595148786846449360_1160 src: /127.0.0.1:40458 dest: /127.0.0.1:46399
2013-10-31 20:36:38,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40458, dest: /127.0.0.1:46399, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_2595148786846449360_1160, duration: 653522
2013-10-31 20:36:38,942 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2595148786846449360_1160 terminating
2013-10-31 20:36:38,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44749, dest: /127.0.0.1:33202, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_2595148786846449360_1160, duration: 2263932
2013-10-31 20:36:38,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2595148786846449360_1160 terminating
2013-10-31 20:36:38,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36362, dest: /127.0.0.1:49827, bytes: 78, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2595148786846449360_1160, duration: 4096004
2013-10-31 20:36:38,945 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_2595148786846449360_1160 size 78
2013-10-31 20:36:38,946 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2595148786846449360_1160 terminating
2013-10-31 20:36:38,947 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_2595148786846449360_1160 size 78
2013-10-31 20:36:38,948 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:36:38,948 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:36:38,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_2595148786846449360_1160 size 78
2013-10-31 20:36:38,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:38,971 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml. blk_248548855856716380_1161
2013-10-31 20:36:38,973 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_248548855856716380_1161 src: /127.0.0.1:44751 dest: /127.0.0.1:33202
2013-10-31 20:36:38,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_248548855856716380_1161 src: /127.0.0.1:40460 dest: /127.0.0.1:46399
2013-10-31 20:36:38,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_248548855856716380_1161 src: /127.0.0.1:36367 dest: /127.0.0.1:49827
2013-10-31 20:36:38,981 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36367, dest: /127.0.0.1:49827, bytes: 29357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_248548855856716380_1161, duration: 2062322
2013-10-31 20:36:38,982 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_248548855856716380_1161 terminating
2013-10-31 20:36:38,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40460, dest: /127.0.0.1:46399, bytes: 29357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_248548855856716380_1161, duration: 4039175
2013-10-31 20:36:38,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_248548855856716380_1161 terminating
2013-10-31 20:36:38,985 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_248548855856716380_1161 size 29357
2013-10-31 20:36:38,985 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44751, dest: /127.0.0.1:33202, bytes: 29357, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_248548855856716380_1161, duration: 5854682
2013-10-31 20:36:38,986 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_248548855856716380_1161 terminating
2013-10-31 20:36:38,987 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml from client DFSClient_848976415
2013-10-31 20:36:38,988 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml is closed by DFSClient_848976415
2013-10-31 20:36:38,988 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_248548855856716380_1161 size 29357
2013-10-31 20:36:38,989 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_248548855856716380_1161 size 29357
2013-10-31 20:36:39,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml dst=null perm=null
2013-10-31 20:36:39,003 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36369, bytes: 29589, op: HDFS_READ, cliID: DFSClient_859636949, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_248548855856716380_1161, duration: 401583
2013-10-31 20:36:39,020 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0018: nMaps=2 nReduces=1 max=-1
2013-10-31 20:36:39,020 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0018 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:36:39,021 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0018
2013-10-31 20:36:39,021 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0018 RESULT=SUCCESS
2013-10-31 20:36:39,021 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0018
2013-10-31 20:36:39,022 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0018
2013-10-31 20:36:39,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_1383251798993_hadoop_%5B3865735670994C549F7AB90EE6076908%2FA9AD6DBFCA9F4804 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:39,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:39,042 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_conf.xml. blk_3073360408071600977_1163
2013-10-31 20:36:39,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3073360408071600977_1163 src: /127.0.0.1:36370 dest: /127.0.0.1:49827
2013-10-31 20:36:39,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3073360408071600977_1163 src: /127.0.0.1:40465 dest: /127.0.0.1:46399
2013-10-31 20:36:39,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3073360408071600977_1163 src: /127.0.0.1:44758 dest: /127.0.0.1:33202
2013-10-31 20:36:39,052 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44758, dest: /127.0.0.1:33202, bytes: 29422, op: HDFS_WRITE, cliID: DFSClient_859636949, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_3073360408071600977_1163, duration: 3269530
2013-10-31 20:36:39,052 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3073360408071600977_1163 terminating
2013-10-31 20:36:39,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_3073360408071600977_1163 size 29422
2013-10-31 20:36:39,053 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40465, dest: /127.0.0.1:46399, bytes: 29422, op: HDFS_WRITE, cliID: DFSClient_859636949, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3073360408071600977_1163, duration: 4473536
2013-10-31 20:36:39,053 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3073360408071600977_1163 terminating
2013-10-31 20:36:39,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3073360408071600977_1163 size 29422
2013-10-31 20:36:39,055 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36370, dest: /127.0.0.1:49827, bytes: 29422, op: HDFS_WRITE, cliID: DFSClient_859636949, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3073360408071600977_1163, duration: 5397257
2013-10-31 20:36:39,055 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3073360408071600977_1163 size 29422
2013-10-31 20:36:39,055 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3073360408071600977_1163 terminating
2013-10-31 20:36:39,058 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_conf.xml from client DFSClient_859636949
2013-10-31 20:36:39,058 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_conf.xml is closed by DFSClient_859636949
2013-10-31 20:36:39,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:39,078 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken. blk_-1059650628043549578_1164
2013-10-31 20:36:39,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059650628043549578_1164 src: /127.0.0.1:40467 dest: /127.0.0.1:46399
2013-10-31 20:36:39,081 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059650628043549578_1164 src: /127.0.0.1:36374 dest: /127.0.0.1:49827
2013-10-31 20:36:39,083 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059650628043549578_1164 src: /127.0.0.1:34979 dest: /127.0.0.1:37249
2013-10-31 20:36:39,090 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34979, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1059650628043549578_1164, duration: 2127152
2013-10-31 20:36:39,091 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1059650628043549578_1164 terminating
2013-10-31 20:36:39,091 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36374, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1059650628043549578_1164, duration: 5814167
2013-10-31 20:36:39,092 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1059650628043549578_1164 terminating
2013-10-31 20:36:39,092 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40467, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1059650628043549578_1164, duration: 6783901
2013-10-31 20:36:39,093 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1059650628043549578_1164 terminating
2013-10-31 20:36:39,094 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1059650628043549578_1164 size 116
2013-10-31 20:36:39,095 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken from client DFSClient_848976415
2013-10-31 20:36:39,095 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken is closed by DFSClient_848976415
2013-10-31 20:36:39,096 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1059650628043549578_1164 size 116
2013-10-31 20:36:39,096 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-1059650628043549578_1164 size 116
2013-10-31 20:36:39,101 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken
2013-10-31 20:36:39,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.splitmetainfo dst=null perm=null
2013-10-31 20:36:39,105 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36376, bytes: 82, op: HDFS_READ, cliID: DFSClient_859636949, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_2595148786846449360_1160, duration: 267571
2013-10-31 20:36:39,106 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0018 = 38. Number of splits = 2
2013-10-31 20:36:39,106 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:39,106 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:39,106 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:39,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:39,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:39,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:36:39,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0018 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:36:39,108 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0018 initialized successfully with 2 map tasks and 1 reduce tasks.
2013-10-31 20:36:39,275 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0018_m_000003_0' to tip task_20131031202710049_0018_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:36:39,279 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_m_000001_0'
2013-10-31 20:36:39,280 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0018_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:36:39,281 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0018_m_000003_0 which needs 1 slots
2013-10-31 20:36:39,281 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0018_m_000003_0 which needs 1 slots
2013-10-31 20:36:39,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken dst=null perm=null
2013-10-31 20:36:39,290 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40471, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-1059650628043549578_1164, duration: 267418
2013-10-31 20:36:39,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml dst=null perm=null
2013-10-31 20:36:39,301 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40473, bytes: 29589, op: HDFS_READ, cliID: DFSClient_442270485, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_248548855856716380_1161, duration: 367884
2013-10-31 20:36:39,330 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:36:39,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar dst=null perm=null
2013-10-31 20:36:39,366 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36380, bytes: 239915, op: HDFS_READ, cliID: DFSClient_442270485, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-54307569641458215_1158, duration: 1649274
2013-10-31 20:36:39,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3584747716999234662_1149 file build/test/data/dfs/data/data4/current/blk_-3584747716999234662 for deletion
2013-10-31 20:36:39,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2471405387911211681_1150 file build/test/data/dfs/data/data3/current/blk_-2471405387911211681 for deletion
2013-10-31 20:36:39,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3584747716999234662_1149 at file build/test/data/dfs/data/data4/current/blk_-3584747716999234662
2013-10-31 20:36:39,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633397748358418475_1151 file build/test/data/dfs/data/data4/current/blk_7633397748358418475 for deletion
2013-10-31 20:36:39,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2471405387911211681_1150 at file build/test/data/dfs/data/data3/current/blk_-2471405387911211681
2013-10-31 20:36:39,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633397748358418475_1151 at file build/test/data/dfs/data/data4/current/blk_7633397748358418475
2013-10-31 20:36:39,452 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_m_000002_0'
2013-10-31 20:36:39,466 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0018_m_-125770253
2013-10-31 20:36:39,467 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0018_m_-125770253 spawned.
2013-10-31 20:36:39,468 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0018/attempt_20131031202710049_0018_m_000003_0/taskjvm.sh
2013-10-31 20:36:39,708 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0017_m_000003_0'
2013-10-31 20:36:40,203 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8539299561913017447_1152 file build/test/data/dfs/data/data7/current/blk_-8539299561913017447 for deletion
2013-10-31 20:36:40,203 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3584747716999234662_1149 file build/test/data/dfs/data/data7/current/blk_-3584747716999234662 for deletion
2013-10-31 20:36:40,203 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8539299561913017447_1152 at file build/test/data/dfs/data/data7/current/blk_-8539299561913017447
2013-10-31 20:36:40,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2471405387911211681_1150 file build/test/data/dfs/data/data8/current/blk_-2471405387911211681 for deletion
2013-10-31 20:36:40,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3584747716999234662_1149 at file build/test/data/dfs/data/data7/current/blk_-3584747716999234662
2013-10-31 20:36:40,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2471405387911211681_1150 at file build/test/data/dfs/data/data8/current/blk_-2471405387911211681
2013-10-31 20:36:40,496 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:33202 to replicate blk_-54307569641458215_1158 to datanode(s) 127.0.0.1:37249
2013-10-31 20:36:40,496 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_6286107620319586138_1155
2013-10-31 20:36:40,497 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_6286107620319586138_1155
2013-10-31 20:36:41,001 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0018_m_-125770253 given task: attempt_20131031202710049_0018_m_000003_0
2013-10-31 20:36:41,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:41,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6286107620319586138_1155 file build/test/data/dfs/data/data2/current/blk_6286107620319586138 for deletion
2013-10-31 20:36:41,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6286107620319586138_1155 at file build/test/data/dfs/data/data2/current/blk_6286107620319586138
2013-10-31 20:36:42,368 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909) Starting thread to transfer block blk_-54307569641458215_1158 to 127.0.0.1:37249
2013-10-31 20:36:42,371 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-54307569641458215_1158 src: /127.0.0.1:34987 dest: /127.0.0.1:37249
2013-10-31 20:36:42,371 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:33202, storageID=DS-847897947-10.5.128.102-33202-1383251229143, infoPort=36813, ipcPort=42909):Transmitted block blk_-54307569641458215_1158 to /127.0.0.1:37249
2013-10-31 20:36:42,374 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-54307569641458215_1158 src: /127.0.0.1:34987 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:36:42,378 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-54307569641458215_1158 size 238055
2013-10-31 20:36:43,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6286107620319586138_1155 file build/test/data/dfs/data/data7/current/blk_6286107620319586138 for deletion
2013-10-31 20:36:43,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6286107620319586138_1155 at file build/test/data/dfs/data/data7/current/blk_6286107620319586138
2013-10-31 20:36:43,320 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0017
2013-10-31 20:36:43,320 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0017_m_000004_0 not found in cache
2013-10-31 20:36:43,321 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0017 for user-log deletion with retainTimeStamp:1383338203321
2013-10-31 20:36:43,415 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0017_r_699960213 since job job_20131031202710049_0017 is dead
2013-10-31 20:36:43,426 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1175 with signal TERM. Exit code 0
2013-10-31 20:36:43,497 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_6286107620319586138_1155
2013-10-31 20:36:43,600 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:43,600 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:43,600 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:43,600 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0017_r_699960213 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:44,058 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0017_m_-652891250 since job job_20131031202710049_0017 is dead
2013-10-31 20:36:44,068 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group891 with signal TERM. Exit code 0
2013-10-31 20:36:44,281 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0017
2013-10-31 20:36:44,283 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0017 for user-log deletion with retainTimeStamp:1383338204282
2013-10-31 20:36:44,305 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:44,305 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:44,305 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:44,305 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0017_m_-652891250 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:44,421 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_m_000003_0 0.0% setup
2013-10-31 20:36:44,424 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0018_m_000003_0 is done.
2013-10-31 20:36:44,424 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0018_m_000003_0 was -1
2013-10-31 20:36:44,425 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:44,445 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0017_m_429120515 since job job_20131031202710049_0017 is dead
2013-10-31 20:36:44,453 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0017
2013-10-31 20:36:44,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0017 for user-log deletion with retainTimeStamp:1383338204453
2013-10-31 20:36:44,455 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group784 with signal TERM. Exit code 0
2013-10-31 20:36:44,537 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0017_m_-1394926320 since job job_20131031202710049_0017 is dead
2013-10-31 20:36:44,547 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group973 with signal TERM. Exit code 0
2013-10-31 20:36:44,633 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:44,633 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:44,633 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:44,633 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0017_m_429120515 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:36:44,709 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0017
2013-10-31 20:36:44,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0017 for user-log deletion with retainTimeStamp:1383338204710
2013-10-31 20:36:44,822 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:44,822 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:44,822 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:44,822 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0017_m_-1394926320 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:45,029 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0017_m_-1487284786 since job job_20131031202710049_0017 is dead
2013-10-31 20:36:45,039 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1020 with signal TERM. Exit code 0
2013-10-31 20:36:45,267 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:45,267 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:45,268 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:45,268 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0017_m_-1487284786 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:45,274 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0017_m_1227799006 since job job_20131031202710049_0017 is dead
2013-10-31 20:36:45,280 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-7982940896742994746_1010
2013-10-31 20:36:45,282 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1066 with signal TERM. Exit code 0
2013-10-31 20:36:45,286 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0018_m_000003_0' has completed task_20131031202710049_0018_m_000003 successfully.
2013-10-31 20:36:45,289 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0018_m_000000_0' to tip task_20131031202710049_0018_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:36:45,290 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0018_m_000000
2013-10-31 20:36:45,292 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0018_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:36:45,292 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0018_m_000000_0 which needs 1 slots
2013-10-31 20:36:45,293 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0018_m_000000_0 which needs 1 slots
2013-10-31 20:36:45,325 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0018_m_-1904657667
2013-10-31 20:36:45,325 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0018_m_-1904657667 spawned.
2013-10-31 20:36:45,327 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0018/attempt_20131031202710049_0018_m_000000_0/taskjvm.sh
2013-10-31 20:36:45,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6286107620319586138_1155 file build/test/data/dfs/data/data3/current/blk_6286107620319586138 for deletion
2013-10-31 20:36:45,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6286107620319586138_1155 at file build/test/data/dfs/data/data3/current/blk_6286107620319586138
2013-10-31 20:36:45,459 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0018_m_000001_0' to tip task_20131031202710049_0018_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55898'
2013-10-31 20:36:45,487 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0018_m_000001
2013-10-31 20:36:45,488 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0018_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:36:45,488 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0018_m_000001_0 which needs 1 slots
2013-10-31 20:36:45,488 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0018_m_000001_0 which needs 1 slots
2013-10-31 20:36:45,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018/jobToken dst=null perm=null
2013-10-31 20:36:45,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34988, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1059650628043549578_1164, duration: 140050
2013-10-31 20:36:45,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.xml dst=null perm=null
2013-10-31 20:36:45,501 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36386, bytes: 29589, op: HDFS_READ, cliID: DFSClient_-1571303135, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_248548855856716380_1161, duration: 249916
2013-10-31 20:36:45,569 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:36:45,570 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:36:45,570 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:36:45,571 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:36:45,571 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0017_m_1227799006 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:36:45,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.jar dst=null perm=null
2013-10-31 20:36:45,606 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34991, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1571303135, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-54307569641458215_1158, duration: 1582133
2013-10-31 20:36:45,678 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0018_m_359820581
2013-10-31 20:36:45,678 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0018_m_359820581 spawned.
2013-10-31 20:36:45,679 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0018/attempt_20131031202710049_0018_m_000001_0/taskjvm.sh
2013-10-31 20:36:46,402 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0018_m_-1904657667 given task: attempt_20131031202710049_0018_m_000000_0
2013-10-31 20:36:46,656 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0018_m_359820581 given task: attempt_20131031202710049_0018_m_000001_0
2013-10-31 20:36:46,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split dst=null perm=null
2013-10-31 20:36:46,909 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40485, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0018_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3002066176191991015_1159, duration: 167424
2013-10-31 20:36:46,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:36:47,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018/job.split dst=null perm=null
2013-10-31 20:36:47,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34997, bytes: 705, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0018_m_000001_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3002066176191991015_1159, duration: 168722
2013-10-31 20:36:47,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:36:47,202 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40488, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0018_m_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4376294229090259720_1013, duration: 120095
2013-10-31 20:36:47,454 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:34999, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0018_m_000001_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 297717
2013-10-31 20:36:49,841 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+19
2013-10-31 20:36:49,843 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0018_m_000000_0 is done.
2013-10-31 20:36:49,844 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0018_m_000000_0 was 340
2013-10-31 20:36:49,844 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:50,093 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+19
2013-10-31 20:36:50,096 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0018_m_000001_0 is done.
2013-10-31 20:36:50,096 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0018_m_000001_0 was 340
2013-10-31 20:36:50,096 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:36:50,293 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0018_m_000003_0
2013-10-31 20:36:50,293 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0018_m_000003_0
2013-10-31 20:36:50,293 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0018_m_000003_0 not found in cache
2013-10-31 20:36:51,299 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0018_m_000000_0' has completed task_20131031202710049_0018_m_000000 successfully.
2013-10-31 20:36:51,301 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0018_r_000000_0' to tip task_20131031202710049_0018_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:36:51,304 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0018_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:36:51,304 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0018_r_000000_0 which needs 1 slots
2013-10-31 20:36:51,304 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0018_r_000000_0 which needs 1 slots
2013-10-31 20:36:51,341 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0018_r_1664053101
2013-10-31 20:36:51,342 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0018_r_1664053101 spawned.
2013-10-31 20:36:51,344 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0018/attempt_20131031202710049_0018_r_000000_0/taskjvm.sh
2013-10-31 20:36:51,494 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0018_m_000001_0' has completed task_20131031202710049_0018_m_000001 successfully.
2013-10-31 20:36:52,210 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0018_r_1664053101 given task: attempt_20131031202710049_0018_r_000000_0
2013-10-31 20:36:57,874 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:54044, bytes: 340, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0018_m_000000_0, duration: 11829993
2013-10-31 20:36:57,902 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54828, dest: 10.5.128.102:54337, bytes: 340, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0018_m_000001_0, duration: 12842408
2013-10-31 20:36:58,688 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:36:58,732 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:36:58,795 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:36:59,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:36:59,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:36:59,057 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0/part-00000. blk_1615840019968489592_1165
2013-10-31 20:36:59,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1615840019968489592_1165 src: /127.0.0.1:35006 dest: /127.0.0.1:37249
2013-10-31 20:36:59,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1615840019968489592_1165 src: /127.0.0.1:36403 dest: /127.0.0.1:49827
2013-10-31 20:36:59,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1615840019968489592_1165 src: /127.0.0.1:44790 dest: /127.0.0.1:33202
2013-10-31 20:36:59,100 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44790, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0018_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1615840019968489592_1165, duration: 2071162
2013-10-31 20:36:59,101 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1615840019968489592_1165 terminating
2013-10-31 20:36:59,101 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36403, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0018_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1615840019968489592_1165, duration: 4352735
2013-10-31 20:36:59,101 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1615840019968489592_1165 terminating
2013-10-31 20:36:59,102 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35006, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0018_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1615840019968489592_1165, duration: 4413425
2013-10-31 20:36:59,102 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1615840019968489592_1165 terminating
2013-10-31 20:36:59,104 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_1615840019968489592_1165 size 708
2013-10-31 20:36:59,104 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0018_r_000000_0
2013-10-31 20:36:59,104 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0018_r_000000_0
2013-10-31 20:36:59,104 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_1615840019968489592_1165 size 708
2013-10-31 20:36:59,106 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_1615840019968489592_1165 size 708
2013-10-31 20:36:59,144 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0018_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:36:59,145 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_r_000000_0 0.33333334% reduce > copy (2 of 2 at 0.00 MB/s)
2013-10-31 20:37:00,312 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031202710049_0018_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:35954
2013-10-31 20:37:00,313 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0018_r_000000_0
2013-10-31 20:37:01,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0 dst=null perm=null
2013-10-31 20:37:01,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:01,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:01,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary/_attempt_20131031202710049_0018_r_000000_0 dst=null perm=null
2013-10-31 20:37:01,740 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_r_000000_0 1.0% reduce > reduce
2013-10-31 20:37:01,743 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_r_000000_0 1.0% reduce > reduce
2013-10-31 20:37:01,744 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0018_r_000000_0 is done.
2013-10-31 20:37:01,744 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0018_r_000000_0 was -1
2013-10-31 20:37:01,744 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:03,317 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0018_r_000000_0' has completed task_20131031202710049_0018_r_000000 successfully.
2013-10-31 20:37:03,321 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0018_m_000002_0' to tip task_20131031202710049_0018_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:37:03,324 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0018_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:37:03,324 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0018_m_000002_0 which needs 1 slots
2013-10-31 20:37:03,325 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0018_m_000002_0 which needs 1 slots
2013-10-31 20:37:03,363 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0018/attempt_20131031202710049_0018_m_000002_0. Attempting to reuse: jvm_20131031202710049_0018_m_-125770253
2013-10-31 20:37:04,503 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0018_m_-125770253 given task: attempt_20131031202710049_0018_m_000002_0
2013-10-31 20:37:04,620 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_m_000002_0 0.0%
2013-10-31 20:37:04,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_temporary dst=null perm=null
2013-10-31 20:37:04,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:04,646 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_SUCCESS from client DFSClient_attempt_20131031202710049_0018_m_000002_0
2013-10-31 20:37:04,646 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0018_m_000002_0
2013-10-31 20:37:04,653 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-54307569641458215 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:04,653 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-54307569641458215 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:04,653 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-54307569641458215 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:04,653 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-54307569641458215 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:04,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002066176191991015 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:04,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002066176191991015 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:04,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002066176191991015 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:04,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002066176191991015 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:04,655 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2595148786846449360 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:04,655 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2595148786846449360 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:04,655 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2595148786846449360 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:04,655 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_248548855856716380 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:04,655 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_248548855856716380 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:04,656 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_248548855856716380 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:04,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0018 dst=null perm=null
2013-10-31 20:37:07,501 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_2595148786846449360_1160 blk_248548855856716380_1161 blk_-54307569641458215_1158 blk_-3002066176191991015_1159
2013-10-31 20:37:07,501 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_2595148786846449360_1160 blk_248548855856716380_1161 blk_-54307569641458215_1158 blk_-3002066176191991015_1159
2013-10-31 20:37:07,592 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0018_m_000002_0 0.0% cleanup
2013-10-31 20:37:07,593 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0018_m_000002_0 is done.
2013-10-31 20:37:07,594 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0018_m_000002_0 was -1
2013-10-31 20:37:07,594 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:08,051 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:37:08,062 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:37:08,067 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:37:08,073 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:37:08,078 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:37:08,083 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:37:08,089 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:37:08,089 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:37:08,325 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0018_r_000000_0
2013-10-31 20:37:08,325 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0018_r_000000_0
2013-10-31 20:37:09,332 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0018_m_000002_0' has completed task_20131031202710049_0018_m_000002 successfully.
2013-10-31 20:37:09,333 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0018 has completed successfully.
2013-10-31 20:37:09,334 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0018,submitTime=1383251798993,launchTime=1383251799108,firstMapTaskLaunchTime=1383251805288,firstReduceTaskLaunchTime=1383251811301,firstJobSetupTaskLaunchTime=1383251799274,firstJobCleanupTaskLaunchTime=1383251823321,finishTime=1383251829333,numMaps=2,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=18,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3865735670994C549F7AB90EE6076908/A9AD6DBFCA9F4804B25B133905CC8B0B] lower*upper/(1/2)
2013-10-31 20:37:09,340 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_1383251798993_hadoop_%5B3865735670994C549F7AB90EE6076908%2FA9AD6DBFCA9F4804. blk_-6860911443063295955_1166
2013-10-31 20:37:09,344 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6860911443063295955_1166 src: /127.0.0.1:36407 dest: /127.0.0.1:49827
2013-10-31 20:37:09,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6860911443063295955_1166 src: /127.0.0.1:35012 dest: /127.0.0.1:37249
2013-10-31 20:37:09,349 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6860911443063295955_1166 src: /127.0.0.1:40503 dest: /127.0.0.1:46399
2013-10-31 20:37:09,362 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40503, dest: /127.0.0.1:46399, bytes: 20681, op: HDFS_WRITE, cliID: DFSClient_859636949, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6860911443063295955_1166, duration: 9591648
2013-10-31 20:37:09,363 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6860911443063295955_1166 terminating
2013-10-31 20:37:09,364 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35012, dest: /127.0.0.1:37249, bytes: 20681, op: HDFS_WRITE, cliID: DFSClient_859636949, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6860911443063295955_1166, duration: 5523245
2013-10-31 20:37:09,364 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6860911443063295955_1166 terminating
2013-10-31 20:37:09,366 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36407, dest: /127.0.0.1:49827, bytes: 20681, op: HDFS_WRITE, cliID: DFSClient_859636949, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-6860911443063295955_1166, duration: 10129191
2013-10-31 20:37:09,366 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-6860911443063295955_1166 size 20681
2013-10-31 20:37:09,366 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6860911443063295955_1166 terminating
2013-10-31 20:37:09,371 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-6860911443063295955_1166 size 20681
2013-10-31 20:37:09,372 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_1383251798993_hadoop_%5B3865735670994C549F7AB90EE6076908%2FA9AD6DBFCA9F4804 from client DFSClient_859636949
2013-10-31 20:37:09,372 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/_logs/history/job_20131031202710049_0018_1383251798993_hadoop_%5B3865735670994C549F7AB90EE6076908%2FA9AD6DBFCA9F4804 is closed by DFSClient_859636949
2013-10-31 20:37:09,373 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-6860911443063295955_1166 size 20681
2013-10-31 20:37:09,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002066176191991015_1159 file build/test/data/dfs/data/data3/current/blk_-3002066176191991015 for deletion
2013-10-31 20:37:09,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-54307569641458215_1158 file build/test/data/dfs/data/data4/current/blk_-54307569641458215 for deletion
2013-10-31 20:37:09,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002066176191991015_1159 at file build/test/data/dfs/data/data3/current/blk_-3002066176191991015
2013-10-31 20:37:09,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_248548855856716380_1161 file build/test/data/dfs/data/data3/current/blk_248548855856716380 for deletion
2013-10-31 20:37:09,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-54307569641458215_1158 at file build/test/data/dfs/data/data4/current/blk_-54307569641458215
2013-10-31 20:37:09,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_248548855856716380_1161 at file build/test/data/dfs/data/data3/current/blk_248548855856716380
2013-10-31 20:37:09,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2595148786846449360_1160 file build/test/data/dfs/data/data4/current/blk_2595148786846449360 for deletion
2013-10-31 20:37:09,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2595148786846449360_1160 at file build/test/data/dfs/data/data4/current/blk_2595148786846449360
2013-10-31 20:37:09,382 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0018_1383251798993_hadoop_%5B3865735670994C549F7AB90EE6076908%2FA9AD6DBFCA9F4804 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:37:09,383 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0018_m_000000_0'
2013-10-31 20:37:09,383 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0018_m_000002_0'
2013-10-31 20:37:09,384 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0018_m_000003_0'
2013-10-31 20:37:09,384 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0018_r_000000_0'
2013-10-31 20:37:09,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059650628043549578 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:09,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059650628043549578 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:09,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059650628043549578 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:09,389 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0018_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:37:09,389 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2) ...lue/true/false/false/true
2013-10-31 20:37:09,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0018 dst=null perm=null
2013-10-31 20:37:09,398 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 1
2013-10-31 20:37:09,398 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:37:09,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:09,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:37:09,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:09,422 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar. blk_-7549476930694728541_1167
2013-10-31 20:37:09,424 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549476930694728541_1167 src: /127.0.0.1:36411 dest: /127.0.0.1:49827
2013-10-31 20:37:09,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549476930694728541_1167 src: /127.0.0.1:40506 dest: /127.0.0.1:46399
2013-10-31 20:37:09,427 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549476930694728541_1167 src: /127.0.0.1:35017 dest: /127.0.0.1:37249
2013-10-31 20:37:09,439 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35017, dest: /127.0.0.1:37249, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-7549476930694728541_1167, duration: 9060554
2013-10-31 20:37:09,440 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7549476930694728541_1167 terminating
2013-10-31 20:37:09,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-7549476930694728541_1167 size 238055
2013-10-31 20:37:09,441 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40506, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-7549476930694728541_1167, duration: 10746918
2013-10-31 20:37:09,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-7549476930694728541_1167 size 238055
2013-10-31 20:37:09,442 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7549476930694728541_1167 terminating
2013-10-31 20:37:09,443 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36411, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7549476930694728541_1167, duration: 12660581
2013-10-31 20:37:09,444 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7549476930694728541_1167 terminating
2013-10-31 20:37:09,445 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar from client DFSClient_848976415
2013-10-31 20:37:09,446 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar is closed by DFSClient_848976415
2013-10-31 20:37:09,448 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-7549476930694728541_1167 size 238055
2013-10-31 20:37:09,451 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar. New replication is 10
2013-10-31 20:37:09,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar dst=null perm=null
2013-10-31 20:37:09,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:09,463 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:37:09,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D dst=null perm=null
2013-10-31 20:37:09,468 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:09,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/part-00000 dst=null perm=null
2013-10-31 20:37:09,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:09,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:09,490 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split. New replication is 10
2013-10-31 20:37:09,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split dst=null perm=null
2013-10-31 20:37:09,500 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split. blk_9186460475423874382_1168
2013-10-31 20:37:09,502 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9186460475423874382_1168 src: /127.0.0.1:36414 dest: /127.0.0.1:49827
2013-10-31 20:37:09,503 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9186460475423874382_1168 src: /127.0.0.1:44801 dest: /127.0.0.1:33202
2013-10-31 20:37:09,505 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9186460475423874382_1168 src: /127.0.0.1:35020 dest: /127.0.0.1:37249
2013-10-31 20:37:09,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9186460475423874382_1168 src: /127.0.0.1:40511 dest: /127.0.0.1:46399
2013-10-31 20:37:09,511 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40511, dest: /127.0.0.1:46399, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_9186460475423874382_1168, duration: 1598416
2013-10-31 20:37:09,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9186460475423874382_1168 terminating
2013-10-31 20:37:09,513 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35020, dest: /127.0.0.1:37249, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_9186460475423874382_1168, duration: 2856924
2013-10-31 20:37:09,513 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9186460475423874382_1168 terminating
2013-10-31 20:37:09,514 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44801, dest: /127.0.0.1:33202, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_9186460475423874382_1168, duration: 4574227
2013-10-31 20:37:09,515 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_9186460475423874382_1168 size 358
2013-10-31 20:37:09,515 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9186460475423874382_1168 terminating
2013-10-31 20:37:09,517 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36414, dest: /127.0.0.1:49827, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_9186460475423874382_1168, duration: 6702342
2013-10-31 20:37:09,517 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_9186460475423874382_1168 size 358
2013-10-31 20:37:09,517 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_9186460475423874382_1168 terminating
2013-10-31 20:37:09,520 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0018_m_000001_0'
2013-10-31 20:37:09,520 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_9186460475423874382_1168 size 358
2013-10-31 20:37:09,521 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split from client DFSClient_848976415
2013-10-31 20:37:09,521 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split is closed by DFSClient_848976415
2013-10-31 20:37:09,521 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_9186460475423874382_1168 size 358
2013-10-31 20:37:09,738 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0018
2013-10-31 20:37:09,739 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0018 being deleted.
2013-10-31 20:37:09,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002066176191991015_1159 file build/test/data/dfs/data/data6/current/blk_-3002066176191991015 for deletion
2013-10-31 20:37:09,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-54307569641458215_1158 file build/test/data/dfs/data/data5/current/blk_-54307569641458215 for deletion
2013-10-31 20:37:09,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002066176191991015_1159 at file build/test/data/dfs/data/data6/current/blk_-3002066176191991015
2013-10-31 20:37:09,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_248548855856716380_1161 file build/test/data/dfs/data/data6/current/blk_248548855856716380 for deletion
2013-10-31 20:37:09,824 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-54307569641458215_1158 at file build/test/data/dfs/data/data5/current/blk_-54307569641458215
2013-10-31 20:37:09,824 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2595148786846449360_1160 file build/test/data/dfs/data/data5/current/blk_2595148786846449360 for deletion
2013-10-31 20:37:09,824 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_248548855856716380_1161 at file build/test/data/dfs/data/data6/current/blk_248548855856716380
2013-10-31 20:37:09,824 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2595148786846449360_1160 at file build/test/data/dfs/data/data5/current/blk_2595148786846449360
2013-10-31 20:37:10,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,013 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.splitmetainfo. blk_3734895059033230607_1169
2013-10-31 20:37:10,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3734895059033230607_1169 src: /127.0.0.1:35022 dest: /127.0.0.1:37249
2013-10-31 20:37:10,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3734895059033230607_1169 src: /127.0.0.1:36419 dest: /127.0.0.1:49827
2013-10-31 20:37:10,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3734895059033230607_1169 src: /127.0.0.1:40514 dest: /127.0.0.1:46399
2013-10-31 20:37:10,021 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40514, dest: /127.0.0.1:46399, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_3734895059033230607_1169, duration: 1799804
2013-10-31 20:37:10,022 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3734895059033230607_1169 terminating
2013-10-31 20:37:10,023 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36419, dest: /127.0.0.1:49827, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_3734895059033230607_1169, duration: 2644494
2013-10-31 20:37:10,024 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3734895059033230607_1169 terminating
2013-10-31 20:37:10,025 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35022, dest: /127.0.0.1:37249, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3734895059033230607_1169, duration: 4386107
2013-10-31 20:37:10,025 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3734895059033230607_1169 terminating
2013-10-31 20:37:10,027 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_3734895059033230607_1169 size 45
2013-10-31 20:37:10,028 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:37:10,028 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:37:10,029 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_3734895059033230607_1169 size 45
2013-10-31 20:37:10,029 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_3734895059033230607_1169 size 45
2013-10-31 20:37:10,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,049 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml. blk_-3315019206343914255_1170
2013-10-31 20:37:10,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315019206343914255_1170 src: /127.0.0.1:35025 dest: /127.0.0.1:37249
2013-10-31 20:37:10,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315019206343914255_1170 src: /127.0.0.1:44808 dest: /127.0.0.1:33202
2013-10-31 20:37:10,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315019206343914255_1170 src: /127.0.0.1:36423 dest: /127.0.0.1:49827
2013-10-31 20:37:10,058 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36423, dest: /127.0.0.1:49827, bytes: 28525, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3315019206343914255_1170, duration: 902195
2013-10-31 20:37:10,059 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3315019206343914255_1170 terminating
2013-10-31 20:37:10,060 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44808, dest: /127.0.0.1:33202, bytes: 28525, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3315019206343914255_1170, duration: 2773397
2013-10-31 20:37:10,060 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-3315019206343914255_1170 size 28525
2013-10-31 20:37:10,061 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3315019206343914255_1170 terminating
2013-10-31 20:37:10,062 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35025, dest: /127.0.0.1:37249, bytes: 28525, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3315019206343914255_1170, duration: 4556998
2013-10-31 20:37:10,062 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3315019206343914255_1170 size 28525
2013-10-31 20:37:10,063 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3315019206343914255_1170 terminating
2013-10-31 20:37:10,064 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3315019206343914255_1170 size 28525
2013-10-31 20:37:10,064 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml from client DFSClient_848976415
2013-10-31 20:37:10,065 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml is closed by DFSClient_848976415
2013-10-31 20:37:10,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml dst=null perm=null
2013-10-31 20:37:10,081 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35029, bytes: 28749, op: HDFS_READ, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3315019206343914255_1170, duration: 396975
2013-10-31 20:37:10,099 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0019: nMaps=1 nReduces=1 max=-1
2013-10-31 20:37:10,100 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0019 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:37:10,100 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0019 RESULT=SUCCESS
2013-10-31 20:37:10,100 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0019
2013-10-31 20:37:10,100 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0019
2013-10-31 20:37:10,100 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0019
2013-10-31 20:37:10,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_1383251830070_hadoop_%5B3865735670994C549F7AB90EE6076908%2F3CF5B4F6B1F049B3 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,133 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_conf.xml. blk_5967927461190803907_1172
2013-10-31 20:37:10,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5967927461190803907_1172 src: /127.0.0.1:44812 dest: /127.0.0.1:33202
2013-10-31 20:37:10,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5967927461190803907_1172 src: /127.0.0.1:40521 dest: /127.0.0.1:46399
2013-10-31 20:37:10,136 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5967927461190803907_1172 src: /127.0.0.1:36428 dest: /127.0.0.1:49827
2013-10-31 20:37:10,140 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36428, dest: /127.0.0.1:49827, bytes: 28590, op: HDFS_WRITE, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_5967927461190803907_1172, duration: 1186370
2013-10-31 20:37:10,141 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5967927461190803907_1172 terminating
2013-10-31 20:37:10,141 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_5967927461190803907_1172 size 28590
2013-10-31 20:37:10,142 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40521, dest: /127.0.0.1:46399, bytes: 28590, op: HDFS_WRITE, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_5967927461190803907_1172, duration: 1655882
2013-10-31 20:37:10,142 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5967927461190803907_1172 terminating
2013-10-31 20:37:10,143 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44812, dest: /127.0.0.1:33202, bytes: 28590, op: HDFS_WRITE, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_5967927461190803907_1172, duration: 2921746
2013-10-31 20:37:10,143 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5967927461190803907_1172 terminating
2013-10-31 20:37:10,144 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_conf.xml from client DFSClient_-1413157698
2013-10-31 20:37:10,144 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_conf.xml is closed by DFSClient_-1413157698
2013-10-31 20:37:10,145 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_5967927461190803907_1172 size 28590
2013-10-31 20:37:10,145 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_5967927461190803907_1172 size 28590
2013-10-31 20:37:10,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:10,157 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019/jobToken. blk_7391624925026587137_1173
2013-10-31 20:37:10,158 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7391624925026587137_1173 src: /127.0.0.1:35033 dest: /127.0.0.1:37249
2013-10-31 20:37:10,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7391624925026587137_1173 src: /127.0.0.1:36430 dest: /127.0.0.1:49827
2013-10-31 20:37:10,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7391624925026587137_1173 src: /127.0.0.1:44817 dest: /127.0.0.1:33202
2013-10-31 20:37:10,163 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44817, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_7391624925026587137_1173, duration: 890863
2013-10-31 20:37:10,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7391624925026587137_1173 terminating
2013-10-31 20:37:10,163 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_7391624925026587137_1173 size 116
2013-10-31 20:37:10,163 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36430, dest: /127.0.0.1:49827, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7391624925026587137_1173, duration: 1193216
2013-10-31 20:37:10,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7391624925026587137_1173 terminating
2013-10-31 20:37:10,163 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35033, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_7391624925026587137_1173, duration: 1626837
2013-10-31 20:37:10,164 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7391624925026587137_1173 terminating
2013-10-31 20:37:10,165 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019/jobToken from client DFSClient_848976415
2013-10-31 20:37:10,165 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019/jobToken is closed by DFSClient_848976415
2013-10-31 20:37:10,167 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_7391624925026587137_1173 size 116
2013-10-31 20:37:10,167 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_7391624925026587137_1173 size 116
2013-10-31 20:37:10,171 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019/jobToken
2013-10-31 20:37:10,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.splitmetainfo dst=null perm=null
2013-10-31 20:37:10,173 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35036, bytes: 49, op: HDFS_READ, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_3734895059033230607_1169, duration: 111416
2013-10-31 20:37:10,173 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0019 = 708. Number of splits = 1
2013-10-31 20:37:10,173 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:10,173 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:10,173 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:10,173 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0019 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:37:10,174 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0019 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 20:37:10,502 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37249 to replicate blk_-7549476930694728541_1167 to datanode(s) 127.0.0.1:33202
2013-10-31 20:37:10,502 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_-1059650628043549578_1164 blk_-54307569641458215_1158 blk_-3002066176191991015_1159
2013-10-31 20:37:10,502 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_2595148786846449360_1160 blk_-1059650628043549578_1164 blk_248548855856716380_1161 blk_-54307569641458215_1158 blk_-3002066176191991015_1159
2013-10-31 20:37:11,358 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0019_m_000002_0' to tip task_20131031202710049_0019_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:37:11,367 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0019_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:37:11,367 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0019_m_000002_0 which needs 1 slots
2013-10-31 20:37:11,367 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0018
2013-10-31 20:37:11,367 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0019_m_000002_0 which needs 1 slots
2013-10-31 20:37:11,368 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0018 being deleted.
2013-10-31 20:37:11,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019/jobToken dst=null perm=null
2013-10-31 20:37:11,378 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36433, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_7391624925026587137_1173, duration: 279248
2013-10-31 20:37:11,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.xml dst=null perm=null
2013-10-31 20:37:11,389 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44821, bytes: 28749, op: HDFS_READ, cliID: DFSClient_-955232837, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3315019206343914255_1170, duration: 420899
2013-10-31 20:37:11,420 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:37:11,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.jar dst=null perm=null
2013-10-31 20:37:11,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36436, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-955232837, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-7549476930694728541_1167, duration: 1598046
2013-10-31 20:37:11,564 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0019_m_-938727960
2013-10-31 20:37:11,564 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0019_m_-938727960 spawned.
2013-10-31 20:37:11,567 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0019/attempt_20131031202710049_0019_m_000002_0/taskjvm.sh
2013-10-31 20:37:11,932 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642) Starting thread to transfer block blk_-7549476930694728541_1167 to 127.0.0.1:33202
2013-10-31 20:37:11,933 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002066176191991015_1159 file build/test/data/dfs/data/data2/current/blk_-3002066176191991015 for deletion
2013-10-31 20:37:11,933 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059650628043549578_1164 file build/test/data/dfs/data/data1/current/blk_-1059650628043549578 for deletion
2013-10-31 20:37:11,933 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002066176191991015_1159 at file build/test/data/dfs/data/data2/current/blk_-3002066176191991015
2013-10-31 20:37:11,933 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-54307569641458215_1158 file build/test/data/dfs/data/data2/current/blk_-54307569641458215 for deletion
2013-10-31 20:37:11,933 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059650628043549578_1164 at file build/test/data/dfs/data/data1/current/blk_-1059650628043549578
2013-10-31 20:37:11,934 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-54307569641458215_1158 at file build/test/data/dfs/data/data2/current/blk_-54307569641458215
2013-10-31 20:37:11,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549476930694728541_1167 src: /127.0.0.1:44823 dest: /127.0.0.1:33202
2013-10-31 20:37:11,935 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37249, storageID=DS-962712564-10.5.128.102-37249-1383251228659, infoPort=41185, ipcPort=43642):Transmitted block blk_-7549476930694728541_1167 to /127.0.0.1:33202
2013-10-31 20:37:11,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-7549476930694728541_1167 src: /127.0.0.1:44823 dest: /127.0.0.1:33202 of size 238055
2013-10-31 20:37:11,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-7549476930694728541_1167 size 238055
2013-10-31 20:37:12,692 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0019_m_-938727960 given task: attempt_20131031202710049_0019_m_000002_0
2013-10-31 20:37:13,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:13,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002066176191991015_1159 file build/test/data/dfs/data/data8/current/blk_-3002066176191991015 for deletion
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059650628043549578_1164 file build/test/data/dfs/data/data8/current/blk_-1059650628043549578 for deletion
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-54307569641458215_1158 file build/test/data/dfs/data/data7/current/blk_-54307569641458215 for deletion
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002066176191991015_1159 at file build/test/data/dfs/data/data8/current/blk_-3002066176191991015
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_248548855856716380_1161 file build/test/data/dfs/data/data8/current/blk_248548855856716380 for deletion
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-54307569641458215_1158 at file build/test/data/dfs/data/data7/current/blk_-54307569641458215
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2595148786846449360_1160 file build/test/data/dfs/data/data7/current/blk_2595148786846449360 for deletion
2013-10-31 20:37:13,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059650628043549578_1164 at file build/test/data/dfs/data/data8/current/blk_-1059650628043549578
2013-10-31 20:37:13,215 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2595148786846449360_1160 at file build/test/data/dfs/data/data7/current/blk_2595148786846449360
2013-10-31 20:37:13,215 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_248548855856716380_1161 at file build/test/data/dfs/data/data8/current/blk_248548855856716380
2013-10-31 20:37:13,503 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_-1059650628043549578_1164
2013-10-31 20:37:14,386 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0018
2013-10-31 20:37:14,386 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0018_m_000002_0 not found in cache
2013-10-31 20:37:14,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0018 for user-log deletion with retainTimeStamp:1383338234387
2013-10-31 20:37:14,426 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0018_m_-1904657667 since job job_20131031202710049_0018 is dead
2013-10-31 20:37:14,437 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1551 with signal TERM. Exit code 0
2013-10-31 20:37:14,521 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0018
2013-10-31 20:37:14,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0018 for user-log deletion with retainTimeStamp:1383338234521
2013-10-31 20:37:14,666 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:14,666 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:14,666 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:14,666 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0018_m_-1904657667 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:37:14,683 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0018_m_359820581 since job job_20131031202710049_0018 is dead
2013-10-31 20:37:14,692 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1596 with signal TERM. Exit code 0
2013-10-31 20:37:14,895 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:14,896 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:14,896 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:14,896 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0018_m_359820581 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:37:15,740 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0018_m_-125770253 since job job_20131031202710049_0018 is dead
2013-10-31 20:37:15,750 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1390 with signal TERM. Exit code 0
2013-10-31 20:37:15,784 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0018_r_1664053101 since job job_20131031202710049_0018 is dead
2013-10-31 20:37:15,792 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1693 with signal TERM. Exit code 0
2013-10-31 20:37:15,825 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059650628043549578_1164 file build/test/data/dfs/data/data6/current/blk_-1059650628043549578 for deletion
2013-10-31 20:37:15,825 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059650628043549578_1164 at file build/test/data/dfs/data/data6/current/blk_-1059650628043549578
2013-10-31 20:37:15,942 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:15,943 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:15,943 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:15,943 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0018_m_-125770253 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:37:15,980 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:15,980 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:15,980 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:15,980 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0018_r_1664053101 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:37:16,107 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_m_000002_0 0.0% setup
2013-10-31 20:37:16,110 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0019_m_000002_0 is done.
2013-10-31 20:37:16,110 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0019_m_000002_0 was -1
2013-10-31 20:37:16,110 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:17,373 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0019_m_000002_0' has completed task_20131031202710049_0019_m_000002 successfully.
2013-10-31 20:37:17,493 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0019_m_000000_0' to tip task_20131031202710049_0019_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:37:17,495 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0019_m_000000
2013-10-31 20:37:17,498 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0019_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:37:17,498 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0019_m_000000_0 which needs 1 slots
2013-10-31 20:37:17,499 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0019_m_000000_0 which needs 1 slots
2013-10-31 20:37:17,564 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0019_m_756034583
2013-10-31 20:37:17,565 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0019_m_756034583 spawned.
2013-10-31 20:37:17,569 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0019/attempt_20131031202710049_0019_m_000000_0/taskjvm.sh
2013-10-31 20:37:18,407 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0019_m_756034583 given task: attempt_20131031202710049_0019_m_000000_0
2013-10-31 20:37:18,912 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 20:37:18,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019/job.split dst=null perm=null
2013-10-31 20:37:18,918 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36442, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0019_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_9186460475423874382_1168, duration: 122964
2013-10-31 20:37:18,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/part-00000 dst=null perm=null
2013-10-31 20:37:18,960 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44829, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0019_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1615840019968489592_1165, duration: 377761
2013-10-31 20:37:21,824 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_m_000000_0 1.0% hdfs://localhost:52817/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D/part-00000:0+708
2013-10-31 20:37:21,827 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0019_m_000000_0 is done.
2013-10-31 20:37:21,828 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0019_m_000000_0 was 624
2013-10-31 20:37:21,828 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:22,499 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0019_m_000002_0
2013-10-31 20:37:22,499 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0019_m_000002_0
2013-10-31 20:37:22,499 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0019_m_000002_0 not found in cache
2013-10-31 20:37:23,504 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0019_m_000000_0' has completed task_20131031202710049_0019_m_000000 successfully.
2013-10-31 20:37:23,661 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0019_r_000000_0' to tip task_20131031202710049_0019_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:37:23,663 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0019_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:37:23,664 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0019_r_000000_0 which needs 1 slots
2013-10-31 20:37:23,664 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0019_r_000000_0 which needs 1 slots
2013-10-31 20:37:23,702 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0019_r_1968776560
2013-10-31 20:37:23,703 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0019_r_1968776560 spawned.
2013-10-31 20:37:23,705 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0019/attempt_20131031202710049_0019_r_000000_0/taskjvm.sh
2013-10-31 20:37:24,935 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0019_r_1968776560 given task: attempt_20131031202710049_0019_r_000000_0
2013-10-31 20:37:30,614 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53718, bytes: 624, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0019_m_000000_0, duration: 6038048
2013-10-31 20:37:31,408 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:37:31,474 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:37:31,534 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:37:31,735 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 914 Total time for transactions(ms): 19Number of transactions batched in Syncs: 31 Number of syncs: 634 SyncTimes(ms): 11970 2683
2013-10-31 20:37:31,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:31,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:31,826 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0/part-00000. blk_1362235708104512428_1174
2013-10-31 20:37:31,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1362235708104512428_1174 src: /127.0.0.1:35053 dest: /127.0.0.1:37249
2013-10-31 20:37:31,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1362235708104512428_1174 src: /127.0.0.1:44836 dest: /127.0.0.1:33202
2013-10-31 20:37:31,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1362235708104512428_1174 src: /127.0.0.1:36451 dest: /127.0.0.1:49827
2013-10-31 20:37:31,872 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36451, dest: /127.0.0.1:49827, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0019_r_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1362235708104512428_1174, duration: 1410407
2013-10-31 20:37:31,872 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1362235708104512428_1174 terminating
2013-10-31 20:37:31,873 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44836, dest: /127.0.0.1:33202, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0019_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_1362235708104512428_1174, duration: 2457478
2013-10-31 20:37:31,874 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1362235708104512428_1174 terminating
2013-10-31 20:37:31,875 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_1362235708104512428_1174 size 708
2013-10-31 20:37:31,875 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35053, dest: /127.0.0.1:37249, bytes: 708, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0019_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1362235708104512428_1174, duration: 4636142
2013-10-31 20:37:31,875 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_1362235708104512428_1174 size 708
2013-10-31 20:37:31,875 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1362235708104512428_1174 terminating
2013-10-31 20:37:31,877 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_1362235708104512428_1174 size 708
2013-10-31 20:37:31,877 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0019_r_000000_0
2013-10-31 20:37:31,878 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0019_r_000000_0
2013-10-31 20:37:31,912 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0019_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:37:31,913 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 20:37:32,673 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031202710049_0019_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:52738
2013-10-31 20:37:32,674 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0019_r_000000_0
2013-10-31 20:37:32,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0 dst=null perm=null
2013-10-31 20:37:32,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:32,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:32,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary/_attempt_20131031202710049_0019_r_000000_0 dst=null perm=null
2013-10-31 20:37:34,458 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_r_000000_0 1.0% reduce > reduce
2013-10-31 20:37:34,461 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_r_000000_0 1.0% reduce > reduce
2013-10-31 20:37:34,462 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0019_r_000000_0 is done.
2013-10-31 20:37:34,462 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0019_r_000000_0 was -1
2013-10-31 20:37:34,462 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:35,678 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0019_r_000000_0' has completed task_20131031202710049_0019_r_000000 successfully.
2013-10-31 20:37:35,682 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0019_m_000001_0' to tip task_20131031202710049_0019_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:37:35,684 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0019_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:37:35,685 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0019_m_000001_0 which needs 1 slots
2013-10-31 20:37:35,685 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0019_m_000001_0 which needs 1 slots
2013-10-31 20:37:35,725 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0019/attempt_20131031202710049_0019_m_000001_0. Attempting to reuse: jvm_20131031202710049_0019_m_-938727960
2013-10-31 20:37:36,189 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0019_m_-938727960 given task: attempt_20131031202710049_0019_m_000001_0
2013-10-31 20:37:36,301 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_m_000001_0 0.0%
2013-10-31 20:37:36,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary dst=null perm=null
2013-10-31 20:37:36,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:36,324 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_SUCCESS from client DFSClient_attempt_20131031202710049_0019_m_000001_0
2013-10-31 20:37:36,324 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0019_m_000001_0
2013-10-31 20:37:36,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549476930694728541 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:36,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549476930694728541 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:36,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549476930694728541 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:36,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549476930694728541 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:36,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9186460475423874382 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9186460475423874382 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9186460475423874382 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9186460475423874382 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3734895059033230607 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3734895059033230607 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3734895059033230607 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3315019206343914255 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3315019206343914255 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:36,333 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3315019206343914255 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:36,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0019 dst=null perm=null
2013-10-31 20:37:37,507 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_9186460475423874382_1168 blk_-7549476930694728541_1167 blk_-3315019206343914255_1170
2013-10-31 20:37:37,508 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_9186460475423874382_1168 blk_-7549476930694728541_1167 blk_-3315019206343914255_1170 blk_3734895059033230607_1169
2013-10-31 20:37:39,272 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0019_m_000001_0 0.0% cleanup
2013-10-31 20:37:39,275 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0019_m_000001_0 is done.
2013-10-31 20:37:39,275 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0019_m_000001_0 was -1
2013-10-31 20:37:39,275 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:39,388 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549476930694728541_1167 file build/test/data/dfs/data/data4/current/blk_-7549476930694728541 for deletion
2013-10-31 20:37:39,388 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3315019206343914255_1170 file build/test/data/dfs/data/data3/current/blk_-3315019206343914255 for deletion
2013-10-31 20:37:39,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549476930694728541_1167 at file build/test/data/dfs/data/data4/current/blk_-7549476930694728541
2013-10-31 20:37:39,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3315019206343914255_1170 at file build/test/data/dfs/data/data3/current/blk_-3315019206343914255
2013-10-31 20:37:39,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9186460475423874382_1168 file build/test/data/dfs/data/data4/current/blk_9186460475423874382 for deletion
2013-10-31 20:37:39,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9186460475423874382_1168 at file build/test/data/dfs/data/data4/current/blk_9186460475423874382
2013-10-31 20:37:40,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549476930694728541_1167 file build/test/data/dfs/data/data7/current/blk_-7549476930694728541 for deletion
2013-10-31 20:37:40,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3315019206343914255_1170 file build/test/data/dfs/data/data8/current/blk_-3315019206343914255 for deletion
2013-10-31 20:37:40,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549476930694728541_1167 at file build/test/data/dfs/data/data7/current/blk_-7549476930694728541
2013-10-31 20:37:40,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3734895059033230607_1169 file build/test/data/dfs/data/data7/current/blk_3734895059033230607 for deletion
2013-10-31 20:37:40,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3315019206343914255_1170 at file build/test/data/dfs/data/data8/current/blk_-3315019206343914255
2013-10-31 20:37:40,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3734895059033230607_1169 at file build/test/data/dfs/data/data7/current/blk_3734895059033230607
2013-10-31 20:37:40,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9186460475423874382_1168 file build/test/data/dfs/data/data8/current/blk_9186460475423874382 for deletion
2013-10-31 20:37:40,225 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9186460475423874382_1168 at file build/test/data/dfs/data/data8/current/blk_9186460475423874382
2013-10-31 20:37:40,508 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_9186460475423874382_1168 blk_-7549476930694728541_1167 blk_3734895059033230607_1169
2013-10-31 20:37:40,508 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_9186460475423874382_1168 blk_-7549476930694728541_1167 blk_-3315019206343914255_1170 blk_3734895059033230607_1169
2013-10-31 20:37:40,685 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0019_r_000000_0
2013-10-31 20:37:40,685 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0019_r_000000_0
2013-10-31 20:37:41,694 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0019_m_000001_0' has completed task_20131031202710049_0019_m_000001 successfully.
2013-10-31 20:37:41,695 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0019 has completed successfully.
2013-10-31 20:37:41,695 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0019,submitTime=1383251830070,launchTime=1383251830174,firstMapTaskLaunchTime=1383251837493,firstReduceTaskLaunchTime=1383251843660,firstJobSetupTaskLaunchTime=1383251831357,firstJobCleanupTaskLaunchTime=1383251855682,finishTime=1383251861695,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3865735670994C549F7AB90EE6076908/3CF5B4F6B1F049B3B38D9715E0EF026F] lower*upper/(2/2) ...lue/true/false/false/true
2013-10-31 20:37:41,704 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_1383251830070_hadoop_%5B3865735670994C549F7AB90EE6076908%2F3CF5B4F6B1F049B3. blk_-3473302657849276934_1175
2013-10-31 20:37:41,706 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3473302657849276934_1175 src: /127.0.0.1:36457 dest: /127.0.0.1:49827
2013-10-31 20:37:41,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3473302657849276934_1175 src: /127.0.0.1:40552 dest: /127.0.0.1:46399
2013-10-31 20:37:41,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3473302657849276934_1175 src: /127.0.0.1:44845 dest: /127.0.0.1:33202
2013-10-31 20:37:41,714 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44845, dest: /127.0.0.1:33202, bytes: 16927, op: HDFS_WRITE, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3473302657849276934_1175, duration: 845668
2013-10-31 20:37:41,715 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3473302657849276934_1175 terminating
2013-10-31 20:37:41,716 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3473302657849276934_1175 size 16927
2013-10-31 20:37:41,716 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40552, dest: /127.0.0.1:46399, bytes: 16927, op: HDFS_WRITE, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3473302657849276934_1175, duration: 2717225
2013-10-31 20:37:41,717 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3473302657849276934_1175 terminating
2013-10-31 20:37:41,718 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36457, dest: /127.0.0.1:49827, bytes: 16927, op: HDFS_WRITE, cliID: DFSClient_-1413157698, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-3473302657849276934_1175, duration: 4659474
2013-10-31 20:37:41,719 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3473302657849276934_1175 terminating
2013-10-31 20:37:41,719 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-3473302657849276934_1175 size 16927
2013-10-31 20:37:41,724 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-3473302657849276934_1175 size 16927
2013-10-31 20:37:41,724 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_1383251830070_hadoop_%5B3865735670994C549F7AB90EE6076908%2F3CF5B4F6B1F049B3 from client DFSClient_-1413157698
2013-10-31 20:37:41,725 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_logs/history/job_20131031202710049_0019_1383251830070_hadoop_%5B3865735670994C549F7AB90EE6076908%2F3CF5B4F6B1F049B3 is closed by DFSClient_-1413157698
2013-10-31 20:37:41,732 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0019_1383251830070_hadoop_%5B3865735670994C549F7AB90EE6076908%2F3CF5B4F6B1F049B3 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:37:41,732 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0019_m_000000_0'
2013-10-31 20:37:41,733 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0019_m_000001_0'
2013-10-31 20:37:41,733 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0019_m_000002_0'
2013-10-31 20:37:41,733 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0019_r_000000_0'
2013-10-31 20:37:41,735 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7391624925026587137 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:41,735 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7391624925026587137 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:41,735 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7391624925026587137 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:41,738 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0019_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:37:41,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0019 dst=null perm=null
2013-10-31 20:37:41,741 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6860911443063295955 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:41,741 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6860911443063295955 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:41,741 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6860911443063295955 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:41,742 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3073360408071600977 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:41,742 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3073360408071600977 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:37:41,742 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3073360408071600977 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:41,742 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1615840019968489592 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:37:41,743 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1615840019968489592 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:37:41,743 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1615840019968489592 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:37:41,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1835130542_lower_upper_4DC623EE89694354A8BB2D21B7E1693D dst=null perm=null
2013-10-31 20:37:41,748 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/_temporary
2013-10-31 20:37:41,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true dst=null perm=null
2013-10-31 20:37:41,765 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:41,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/part-00000 dst=null perm=null
2013-10-31 20:37:41,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/part-00000 dst=null perm=null
2013-10-31 20:37:41,769 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36461, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_1362235708104512428_1174, duration: 370338
2013-10-31 20:37:41,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true dst=null perm=null
2013-10-31 20:37:41,778 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:41,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/part-00000 dst=null perm=null
2013-10-31 20:37:41,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/part-00000 dst=null perm=null
2013-10-31 20:37:41,783 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35066, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1362235708104512428_1174, duration: 438525
2013-10-31 20:37:41,783 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true
2013-10-31 20:37:41,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true dst=null perm=null
2013-10-31 20:37:41,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/rawbyteskeyvalue/true/false/false/true/part-00000 dst=null perm=null
2013-10-31 20:37:41,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35067, bytes: 716, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_1362235708104512428_1174, duration: 395461
2013-10-31 20:37:41,799 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 20:37:41,800 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 20:37:41,818 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 20:37:41,819 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 20:37:41,819 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 20:37:41,820 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["SequenceFile[[UNKNOWN]->[0:9]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable"]
2013-10-31 20:37:41,820 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 20:37:41,820 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 20:37:41,820 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 20:37:41,822 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...platform/customerwritable
2013-10-31 20:37:41,826 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 20:37:41,827 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 20:37:41,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:41,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 20:37:41,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:41,849 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar. blk_8439516101647958281_1176
2013-10-31 20:37:41,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8439516101647958281_1176 src: /127.0.0.1:36464 dest: /127.0.0.1:49827
2013-10-31 20:37:41,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8439516101647958281_1176 src: /127.0.0.1:40559 dest: /127.0.0.1:46399
2013-10-31 20:37:41,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8439516101647958281_1176 src: /127.0.0.1:44852 dest: /127.0.0.1:33202
2013-10-31 20:37:41,865 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44852, dest: /127.0.0.1:33202, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_8439516101647958281_1176, duration: 7814920
2013-10-31 20:37:41,865 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8439516101647958281_1176 terminating
2013-10-31 20:37:41,867 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40559, dest: /127.0.0.1:46399, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8439516101647958281_1176, duration: 9391978
2013-10-31 20:37:41,867 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8439516101647958281_1176 terminating
2013-10-31 20:37:41,868 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36464, dest: /127.0.0.1:49827, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8439516101647958281_1176, duration: 11019867
2013-10-31 20:37:41,869 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8439516101647958281_1176 terminating
2013-10-31 20:37:41,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_8439516101647958281_1176 size 238055
2013-10-31 20:37:41,871 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar from client DFSClient_848976415
2013-10-31 20:37:41,871 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar is closed by DFSClient_848976415
2013-10-31 20:37:41,871 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_8439516101647958281_1176 size 238055
2013-10-31 20:37:41,873 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_8439516101647958281_1176 size 238055
2013-10-31 20:37:41,878 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar. New replication is 10
2013-10-31 20:37:41,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar dst=null perm=null
2013-10-31 20:37:41,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:41,892 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 20:37:41,897 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:41,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:37:41,900 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:41,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:37:41,904 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:41,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:37:41,908 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:37:41,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:37:41,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:41,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:41,921 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split. New replication is 10
2013-10-31 20:37:41,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:41,927 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split. blk_4679373457794758132_1177
2013-10-31 20:37:41,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679373457794758132_1177 src: /127.0.0.1:44853 dest: /127.0.0.1:33202
2013-10-31 20:37:41,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679373457794758132_1177 src: /127.0.0.1:36468 dest: /127.0.0.1:49827
2013-10-31 20:37:41,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679373457794758132_1177 src: /127.0.0.1:35073 dest: /127.0.0.1:37249
2013-10-31 20:37:41,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679373457794758132_1177 src: /127.0.0.1:40564 dest: /127.0.0.1:46399
2013-10-31 20:37:41,933 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40564, dest: /127.0.0.1:46399, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4679373457794758132_1177, duration: 1616814
2013-10-31 20:37:41,934 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4679373457794758132_1177 terminating
2013-10-31 20:37:41,935 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35073, dest: /127.0.0.1:37249, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4679373457794758132_1177, duration: 2970907
2013-10-31 20:37:41,935 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4679373457794758132_1177 terminating
2013-10-31 20:37:41,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36468, dest: /127.0.0.1:49827, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4679373457794758132_1177, duration: 3667877
2013-10-31 20:37:41,936 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_4679373457794758132_1177 size 2077
2013-10-31 20:37:41,936 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4679373457794758132_1177 terminating
2013-10-31 20:37:41,937 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44853, dest: /127.0.0.1:33202, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4679373457794758132_1177, duration: 4717298
2013-10-31 20:37:41,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4679373457794758132_1177 terminating
2013-10-31 20:37:41,938 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_4679373457794758132_1177 size 2077
2013-10-31 20:37:41,939 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split from client DFSClient_848976415
2013-10-31 20:37:41,939 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split is closed by DFSClient_848976415
2013-10-31 20:37:41,939 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_4679373457794758132_1177 size 2077
2013-10-31 20:37:41,939 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_4679373457794758132_1177 size 2077
2013-10-31 20:37:41,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549476930694728541_1167 file build/test/data/dfs/data/data1/current/blk_-7549476930694728541 for deletion
2013-10-31 20:37:41,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3315019206343914255_1170 file build/test/data/dfs/data/data2/current/blk_-3315019206343914255 for deletion
2013-10-31 20:37:41,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549476930694728541_1167 at file build/test/data/dfs/data/data1/current/blk_-7549476930694728541
2013-10-31 20:37:41,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3315019206343914255_1170 at file build/test/data/dfs/data/data2/current/blk_-3315019206343914255
2013-10-31 20:37:41,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3734895059033230607_1169 file build/test/data/dfs/data/data1/current/blk_3734895059033230607 for deletion
2013-10-31 20:37:41,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9186460475423874382_1168 file build/test/data/dfs/data/data2/current/blk_9186460475423874382 for deletion
2013-10-31 20:37:41,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3734895059033230607_1169 at file build/test/data/dfs/data/data1/current/blk_3734895059033230607
2013-10-31 20:37:41,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9186460475423874382_1168 at file build/test/data/dfs/data/data2/current/blk_9186460475423874382
2013-10-31 20:37:42,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,402 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.splitmetainfo. blk_-4157729086671526904_1178
2013-10-31 20:37:42,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4157729086671526904_1178 src: /127.0.0.1:36471 dest: /127.0.0.1:49827
2013-10-31 20:37:42,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4157729086671526904_1178 src: /127.0.0.1:35076 dest: /127.0.0.1:37249
2013-10-31 20:37:42,407 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4157729086671526904_1178 src: /127.0.0.1:40567 dest: /127.0.0.1:46399
2013-10-31 20:37:42,410 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40567, dest: /127.0.0.1:46399, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4157729086671526904_1178, duration: 690759
2013-10-31 20:37:42,411 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4157729086671526904_1178 terminating
2013-10-31 20:37:42,411 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-4157729086671526904_1178 size 218
2013-10-31 20:37:42,412 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35076, dest: /127.0.0.1:37249, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-4157729086671526904_1178, duration: 2543605
2013-10-31 20:37:42,413 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4157729086671526904_1178 terminating
2013-10-31 20:37:42,414 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36471, dest: /127.0.0.1:49827, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-4157729086671526904_1178, duration: 4178300
2013-10-31 20:37:42,414 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-4157729086671526904_1178 size 218
2013-10-31 20:37:42,415 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4157729086671526904_1178 terminating
2013-10-31 20:37:42,417 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.splitmetainfo from client DFSClient_848976415
2013-10-31 20:37:42,418 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.splitmetainfo is closed by DFSClient_848976415
2013-10-31 20:37:42,418 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-4157729086671526904_1178 size 218
2013-10-31 20:37:42,423 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0019
2013-10-31 20:37:42,423 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0019 being deleted.
2013-10-31 20:37:42,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,448 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml. blk_-1570148205970777119_1179
2013-10-31 20:37:42,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1570148205970777119_1179 src: /127.0.0.1:36474 dest: /127.0.0.1:49827
2013-10-31 20:37:42,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1570148205970777119_1179 src: /127.0.0.1:44861 dest: /127.0.0.1:33202
2013-10-31 20:37:42,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1570148205970777119_1179 src: /127.0.0.1:35080 dest: /127.0.0.1:37249
2013-10-31 20:37:42,456 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35080, dest: /127.0.0.1:37249, bytes: 29466, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1570148205970777119_1179, duration: 934538
2013-10-31 20:37:42,457 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1570148205970777119_1179 terminating
2013-10-31 20:37:42,458 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-1570148205970777119_1179 size 29466
2013-10-31 20:37:42,458 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44861, dest: /127.0.0.1:33202, bytes: 29466, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-1570148205970777119_1179, duration: 2663303
2013-10-31 20:37:42,459 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1570148205970777119_1179 terminating
2013-10-31 20:37:42,460 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36474, dest: /127.0.0.1:49827, bytes: 29466, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1570148205970777119_1179, duration: 4430390
2013-10-31 20:37:42,460 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1570148205970777119_1179 terminating
2013-10-31 20:37:42,463 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-1570148205970777119_1179 size 29466
2013-10-31 20:37:42,463 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml from client DFSClient_848976415
2013-10-31 20:37:42,464 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml is closed by DFSClient_848976415
2013-10-31 20:37:42,464 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-1570148205970777119_1179 size 29466
2013-10-31 20:37:42,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml dst=null perm=null
2013-10-31 20:37:42,481 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35082, bytes: 29698, op: HDFS_READ, cliID: DFSClient_-898365597, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1570148205970777119_1179, duration: 390096
2013-10-31 20:37:42,500 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031202710049_0020: nMaps=6 nReduces=1 max=-1
2013-10-31 20:37:42,501 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031202710049_0020 added successfully for user 'hadoop' to queue 'default'
2013-10-31 20:37:42,501 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031202710049_0020 RESULT=SUCCESS
2013-10-31 20:37:42,501 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031202710049_0020
2013-10-31 20:37:42,501 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031202710049_0020
2013-10-31 20:37:42,502 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031202710049_0020
2013-10-31 20:37:42,502 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 69 raw values into 1 aggregated values, total 34
2013-10-31 20:37:42,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_1383251862471_hadoop_%5BCC358D4111564BE6A92B4B84203E2C63%2FA957155F623D434F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,522 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_conf.xml. blk_-3480525885753083983_1181
2013-10-31 20:37:42,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3480525885753083983_1181 src: /127.0.0.1:35083 dest: /127.0.0.1:37249
2013-10-31 20:37:42,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3480525885753083983_1181 src: /127.0.0.1:44866 dest: /127.0.0.1:33202
2013-10-31 20:37:42,526 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3480525885753083983_1181 src: /127.0.0.1:40575 dest: /127.0.0.1:46399
2013-10-31 20:37:42,528 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40575, dest: /127.0.0.1:46399, bytes: 29531, op: HDFS_WRITE, cliID: DFSClient_-898365597, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-3480525885753083983_1181, duration: 1931265
2013-10-31 20:37:42,529 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3480525885753083983_1181 terminating
2013-10-31 20:37:42,529 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44866, dest: /127.0.0.1:33202, bytes: 29531, op: HDFS_WRITE, cliID: DFSClient_-898365597, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-3480525885753083983_1181, duration: 1774897
2013-10-31 20:37:42,529 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3480525885753083983_1181 terminating
2013-10-31 20:37:42,530 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35083, dest: /127.0.0.1:37249, bytes: 29531, op: HDFS_WRITE, cliID: DFSClient_-898365597, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-3480525885753083983_1181, duration: 2993194
2013-10-31 20:37:42,530 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3480525885753083983_1181 terminating
2013-10-31 20:37:42,531 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-3480525885753083983_1181 size 29531
2013-10-31 20:37:42,531 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_conf.xml from client DFSClient_-898365597
2013-10-31 20:37:42,532 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_conf.xml is closed by DFSClient_-898365597
2013-10-31 20:37:42,532 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-3480525885753083983_1181 size 29531
2013-10-31 20:37:42,532 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-3480525885753083983_1181 size 29531
2013-10-31 20:37:42,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:37:42,544 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken. blk_-6221039576746366958_1182
2013-10-31 20:37:42,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6221039576746366958_1182 src: /127.0.0.1:40576 dest: /127.0.0.1:46399
2013-10-31 20:37:42,547 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6221039576746366958_1182 src: /127.0.0.1:35087 dest: /127.0.0.1:37249
2013-10-31 20:37:42,549 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6221039576746366958_1182 src: /127.0.0.1:44870 dest: /127.0.0.1:33202
2013-10-31 20:37:42,557 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44870, dest: /127.0.0.1:33202, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6221039576746366958_1182, duration: 2627128
2013-10-31 20:37:42,557 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6221039576746366958_1182 terminating
2013-10-31 20:37:42,558 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0019
2013-10-31 20:37:42,558 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35087, dest: /127.0.0.1:37249, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6221039576746366958_1182, duration: 3342570
2013-10-31 20:37:42,558 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0019 being deleted.
2013-10-31 20:37:42,559 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6221039576746366958_1182 terminating
2013-10-31 20:37:42,559 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-6221039576746366958_1182 size 116
2013-10-31 20:37:42,559 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40576, dest: /127.0.0.1:46399, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6221039576746366958_1182, duration: 4561868
2013-10-31 20:37:42,560 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6221039576746366958_1182 terminating
2013-10-31 20:37:42,563 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken from client DFSClient_848976415
2013-10-31 20:37:42,563 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken is closed by DFSClient_848976415
2013-10-31 20:37:42,563 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-6221039576746366958_1182 size 116
2013-10-31 20:37:42,564 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-6221039576746366958_1182 size 116
2013-10-31 20:37:42,568 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken
2013-10-31 20:37:42,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.splitmetainfo dst=null perm=null
2013-10-31 20:37:42,572 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40579, bytes: 222, op: HDFS_READ, cliID: DFSClient_-898365597, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-4157729086671526904_1178, duration: 267825
2013-10-31 20:37:42,573 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031202710049_0020 = 38. Number of splits = 6
2013-10-31 20:37:42,574 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,574 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,574 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,574 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,575 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,575 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,575 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,575 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,576 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,576 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,576 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,576 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,578 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031202710049_0020_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 20:37:42,578 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031202710049_0020 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 20:37:42,578 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031202710049_0020 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 20:37:42,773 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031202710049_0020_m_000007_0' to tip task_20131031202710049_0020_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:37:42,782 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000007_0 task's state:UNASSIGNED
2013-10-31 20:37:42,782 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0019
2013-10-31 20:37:42,782 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000007_0 which needs 1 slots
2013-10-31 20:37:42,782 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031202710049_0019 being deleted.
2013-10-31 20:37:42,782 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0020_m_000007_0 which needs 1 slots
2013-10-31 20:37:42,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken dst=null perm=null
2013-10-31 20:37:42,791 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40580, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6221039576746366958_1182, duration: 254936
2013-10-31 20:37:42,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml dst=null perm=null
2013-10-31 20:37:42,803 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36488, bytes: 29698, op: HDFS_READ, cliID: DFSClient_-1816440499, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-1570148205970777119_1179, duration: 409613
2013-10-31 20:37:42,831 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:37:42,833 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549476930694728541_1167 file build/test/data/dfs/data/data6/current/blk_-7549476930694728541 for deletion
2013-10-31 20:37:42,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3734895059033230607_1169 file build/test/data/dfs/data/data6/current/blk_3734895059033230607 for deletion
2013-10-31 20:37:42,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549476930694728541_1167 at file build/test/data/dfs/data/data6/current/blk_-7549476930694728541
2013-10-31 20:37:42,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9186460475423874382_1168 file build/test/data/dfs/data/data5/current/blk_9186460475423874382 for deletion
2013-10-31 20:37:42,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3734895059033230607_1169 at file build/test/data/dfs/data/data6/current/blk_3734895059033230607
2013-10-31 20:37:42,835 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9186460475423874382_1168 at file build/test/data/dfs/data/data5/current/blk_9186460475423874382
2013-10-31 20:37:42,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar dst=null perm=null
2013-10-31 20:37:42,868 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36489, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1816440499, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8439516101647958281_1176, duration: 1612618
2013-10-31 20:37:42,962 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_m_745846253
2013-10-31 20:37:42,963 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_m_745846253 spawned.
2013-10-31 20:37:42,965 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_m_000007_0/taskjvm.sh
2013-10-31 20:37:43,509 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:46399 to replicate blk_8439516101647958281_1176 to datanode(s) 127.0.0.1:37249
2013-10-31 20:37:43,510 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_1615840019968489592_1165 blk_7391624925026587137_1173 blk_3073360408071600977_1163
2013-10-31 20:37:43,510 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_1615840019968489592_1165 blk_7391624925026587137_1173 blk_-6860911443063295955_1166
2013-10-31 20:37:44,310 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_745846253 given task: attempt_20131031202710049_0020_m_000007_0
2013-10-31 20:37:44,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:37:44,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6860911443063295955_1166 file build/test/data/dfs/data/data2/current/blk_-6860911443063295955 for deletion
2013-10-31 20:37:44,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1615840019968489592_1165 file build/test/data/dfs/data/data1/current/blk_1615840019968489592 for deletion
2013-10-31 20:37:44,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6860911443063295955_1166 at file build/test/data/dfs/data/data2/current/blk_-6860911443063295955
2013-10-31 20:37:44,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7391624925026587137_1173 file build/test/data/dfs/data/data1/current/blk_7391624925026587137 for deletion
2013-10-31 20:37:44,944 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1615840019968489592_1165 at file build/test/data/dfs/data/data1/current/blk_1615840019968489592
2013-10-31 20:37:44,944 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7391624925026587137_1173 at file build/test/data/dfs/data/data1/current/blk_7391624925026587137
2013-10-31 20:37:45,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1615840019968489592_1165 file build/test/data/dfs/data/data3/current/blk_1615840019968489592 for deletion
2013-10-31 20:37:45,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3073360408071600977_1163 file build/test/data/dfs/data/data4/current/blk_3073360408071600977 for deletion
2013-10-31 20:37:45,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1615840019968489592_1165 at file build/test/data/dfs/data/data3/current/blk_1615840019968489592
2013-10-31 20:37:45,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3073360408071600977_1163 at file build/test/data/dfs/data/data4/current/blk_3073360408071600977
2013-10-31 20:37:45,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7391624925026587137_1173 file build/test/data/dfs/data/data3/current/blk_7391624925026587137 for deletion
2013-10-31 20:37:45,391 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7391624925026587137_1173 at file build/test/data/dfs/data/data3/current/blk_7391624925026587137
2013-10-31 20:37:45,835 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272) Starting thread to transfer block blk_8439516101647958281_1176 to 127.0.0.1:37249
2013-10-31 20:37:45,837 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8439516101647958281_1176 src: /127.0.0.1:35096 dest: /127.0.0.1:37249
2013-10-31 20:37:45,837 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:46399, storageID=DS-1218196606-10.5.128.102-46399-1383251229561, infoPort=38586, ipcPort=35272):Transmitted block blk_8439516101647958281_1176 to /127.0.0.1:37249
2013-10-31 20:37:45,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8439516101647958281_1176 src: /127.0.0.1:35096 dest: /127.0.0.1:37249 of size 238055
2013-10-31 20:37:45,843 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_8439516101647958281_1176 size 238055
2013-10-31 20:37:46,511 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_3073360408071600977_1163 blk_-6860911443063295955_1166
2013-10-31 20:37:46,511 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_1615840019968489592_1165 blk_7391624925026587137_1173 blk_3073360408071600977_1163 blk_-6860911443063295955_1166
2013-10-31 20:37:46,735 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031202710049_0019
2013-10-31 20:37:46,737 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0019_m_000001_0 not found in cache
2013-10-31 20:37:46,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031202710049_0019 for user-log deletion with retainTimeStamp:1383338266737
2013-10-31 20:37:46,999 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0019_r_1968776560 since job job_20131031202710049_0019 is dead
2013-10-31 20:37:47,010 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2100 with signal TERM. Exit code 0
2013-10-31 20:37:47,203 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:47,203 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:47,204 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:47,204 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0019_r_1968776560 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:37:47,313 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0019_m_-938727960 since job job_20131031202710049_0019 is dead
2013-10-31 20:37:47,321 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1892 with signal TERM. Exit code 0
2013-10-31 20:37:47,495 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:47,495 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:47,496 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:47,496 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0019_m_-938727960 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 20:37:47,733 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000007_0 0.0% setup
2013-10-31 20:37:47,736 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000007_0 is done.
2013-10-31 20:37:47,736 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000007_0 was -1
2013-10-31 20:37:47,737 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:47,920 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031202710049_0019_m_756034583 since job job_20131031202710049_0019 is dead
2013-10-31 20:37:47,931 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2019 with signal TERM. Exit code 0
2013-10-31 20:37:48,185 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 20:37:48,186 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 20:37:48,186 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 20:37:48,187 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031202710049_0019_m_756034583 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 20:37:48,787 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000007_0' has completed task_20131031202710049_0020_m_000007 successfully.
2013-10-31 20:37:48,794 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0020_m_000000_0' to tip task_20131031202710049_0020_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:37:48,796 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0020_m_000000
2013-10-31 20:37:48,797 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0020_m_000001_0' to tip task_20131031202710049_0020_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:37:48,797 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0020_m_000001
2013-10-31 20:37:48,799 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000000_0 task's state:UNASSIGNED
2013-10-31 20:37:48,800 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000001_0 task's state:UNASSIGNED
2013-10-31 20:37:48,801 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000000_0 which needs 1 slots
2013-10-31 20:37:48,801 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0020_m_000000_0 which needs 1 slots
2013-10-31 20:37:48,801 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000001_0 which needs 1 slots
2013-10-31 20:37:48,801 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0020_m_000001_0 which needs 1 slots
2013-10-31 20:37:48,836 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6860911443063295955_1166 file build/test/data/dfs/data/data5/current/blk_-6860911443063295955 for deletion
2013-10-31 20:37:48,836 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3073360408071600977_1163 file build/test/data/dfs/data/data5/current/blk_3073360408071600977 for deletion
2013-10-31 20:37:48,836 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6860911443063295955_1166 at file build/test/data/dfs/data/data5/current/blk_-6860911443063295955
2013-10-31 20:37:48,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3073360408071600977_1163 at file build/test/data/dfs/data/data5/current/blk_3073360408071600977
2013-10-31 20:37:48,844 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_m_113604213
2013-10-31 20:37:48,845 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_m_113604213 spawned.
2013-10-31 20:37:48,845 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0020/attempt_20131031202710049_0020_m_000001_0. Attempting to reuse: jvm_20131031202710049_0020_m_745846253
2013-10-31 20:37:48,846 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_m_000000_0/taskjvm.sh
2013-10-31 20:37:49,226 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6860911443063295955_1166 file build/test/data/dfs/data/data8/current/blk_-6860911443063295955 for deletion
2013-10-31 20:37:49,226 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1615840019968489592_1165 file build/test/data/dfs/data/data7/current/blk_1615840019968489592 for deletion
2013-10-31 20:37:49,226 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6860911443063295955_1166 at file build/test/data/dfs/data/data8/current/blk_-6860911443063295955
2013-10-31 20:37:49,226 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3073360408071600977_1163 file build/test/data/dfs/data/data7/current/blk_3073360408071600977 for deletion
2013-10-31 20:37:49,226 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1615840019968489592_1165 at file build/test/data/dfs/data/data7/current/blk_1615840019968489592
2013-10-31 20:37:49,227 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7391624925026587137_1173 file build/test/data/dfs/data/data8/current/blk_7391624925026587137 for deletion
2013-10-31 20:37:49,227 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3073360408071600977_1163 at file build/test/data/dfs/data/data7/current/blk_3073360408071600977
2013-10-31 20:37:49,227 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7391624925026587137_1173 at file build/test/data/dfs/data/data8/current/blk_7391624925026587137
2013-10-31 20:37:49,295 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_745846253 given task: attempt_20131031202710049_0020_m_000001_0
2013-10-31 20:37:49,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:49,399 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44880, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000001_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4679373457794758132_1177, duration: 167871
2013-10-31 20:37:49,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:37:49,440 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35099, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000001_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4376294229090259720_1013, duration: 106823
2013-10-31 20:37:49,810 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_113604213 given task: attempt_20131031202710049_0020_m_000000_0
2013-10-31 20:37:50,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:50,315 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36498, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000000_0, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_4679373457794758132_1177, duration: 166875
2013-10-31 20:37:50,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:37:50,614 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44885, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4376294229090259720_1013, duration: 280378
2013-10-31 20:37:50,750 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0020_m_000002_0' to tip task_20131031202710049_0020_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:37:50,751 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0020_m_000002
2013-10-31 20:37:50,751 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0020_m_000003_0' to tip task_20131031202710049_0020_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:52738'
2013-10-31 20:37:50,752 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0020_m_000003
2013-10-31 20:37:50,754 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000002_0 task's state:UNASSIGNED
2013-10-31 20:37:50,755 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000003_0 task's state:UNASSIGNED
2013-10-31 20:37:50,755 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000002_0 which needs 1 slots
2013-10-31 20:37:50,756 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0020_m_000002_0 which needs 1 slots
2013-10-31 20:37:50,756 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000003_0 which needs 1 slots
2013-10-31 20:37:50,756 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0020_m_000003_0 which needs 1 slots
2013-10-31 20:37:50,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken dst=null perm=null
2013-10-31 20:37:50,766 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44886, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6221039576746366958_1182, duration: 289491
2013-10-31 20:37:50,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml dst=null perm=null
2013-10-31 20:37:50,778 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35106, bytes: 29698, op: HDFS_READ, cliID: DFSClient_85737217, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1570148205970777119_1179, duration: 361667
2013-10-31 20:37:50,813 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:37:50,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar dst=null perm=null
2013-10-31 20:37:50,840 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:49827, dest: /127.0.0.1:36503, bytes: 239915, op: HDFS_READ, cliID: DFSClient_85737217, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_8439516101647958281_1176, duration: 1277426
2013-10-31 20:37:50,919 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_m_-423715002
2013-10-31 20:37:50,920 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_m_-423715002 spawned.
2013-10-31 20:37:50,920 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_m_-296462640
2013-10-31 20:37:50,921 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_m_-296462640 spawned.
2013-10-31 20:37:50,922 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_m_000003_0/taskjvm.sh
2013-10-31 20:37:50,922 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_m_000002_0/taskjvm.sh
2013-10-31 20:37:51,432 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0020_m_000004_0' to tip task_20131031202710049_0020_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:37:51,432 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0020_m_000004
2013-10-31 20:37:51,432 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031202710049_0020_m_000005_0' to tip task_20131031202710049_0020_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:35954'
2013-10-31 20:37:51,432 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031202710049_0020_m_000005
2013-10-31 20:37:51,433 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000004_0 task's state:UNASSIGNED
2013-10-31 20:37:51,434 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000005_0 task's state:UNASSIGNED
2013-10-31 20:37:51,434 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000004_0 which needs 1 slots
2013-10-31 20:37:51,434 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0020_m_000004_0 which needs 1 slots
2013-10-31 20:37:51,434 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000005_0 which needs 1 slots
2013-10-31 20:37:51,434 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031202710049_0020_m_000005_0 which needs 1 slots
2013-10-31 20:37:51,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020/jobToken dst=null perm=null
2013-10-31 20:37:51,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35108, bytes: 120, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6221039576746366958_1182, duration: 159490
2013-10-31 20:37:51,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.xml dst=null perm=null
2013-10-31 20:37:51,443 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35110, bytes: 29698, op: HDFS_READ, cliID: DFSClient_-1304482207, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1570148205970777119_1179, duration: 163771
2013-10-31 20:37:51,456 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 20:37:51,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.jar dst=null perm=null
2013-10-31 20:37:51,471 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40601, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1304482207, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_8439516101647958281_1176, duration: 649731
2013-10-31 20:37:51,525 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_m_2065342323
2013-10-31 20:37:51,526 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_m_2065342323 spawned.
2013-10-31 20:37:51,526 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_m_-543945988
2013-10-31 20:37:51,528 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_m_-543945988 spawned.
2013-10-31 20:37:51,529 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_m_000004_0/taskjvm.sh
2013-10-31 20:37:51,529 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_m_000005_0/taskjvm.sh
2013-10-31 20:37:51,966 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_-296462640 given task: attempt_20131031202710049_0020_m_000002_0
2013-10-31 20:37:51,967 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_-423715002 given task: attempt_20131031202710049_0020_m_000003_0
2013-10-31 20:37:52,361 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000001_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 20:37:52,362 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000001_0 is done.
2013-10-31 20:37:52,362 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000001_0 was 50
2013-10-31 20:37:52,363 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:37:52,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:52,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:52,466 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44898, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000002_0, offset: 512, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4679373457794758132_1177, duration: 177214
2013-10-31 20:37:52,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:33202, dest: /127.0.0.1:44899, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000003_0, offset: 1024, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_4679373457794758132_1177, duration: 240765
2013-10-31 20:37:52,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:37:52,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:37:52,507 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35118, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000003_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 111649
2013-10-31 20:37:52,692 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_2065342323 given task: attempt_20131031202710049_0020_m_000004_0
2013-10-31 20:37:52,723 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_-543945988 given task: attempt_20131031202710049_0020_m_000005_0
2013-10-31 20:37:52,763 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35121, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000002_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 134577
2013-10-31 20:37:53,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:53,224 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:46399, dest: /127.0.0.1:40615, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000005_0, offset: 1536, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_4679373457794758132_1177, duration: 166505
2013-10-31 20:37:53,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020/job.split dst=null perm=null
2013-10-31 20:37:53,233 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35126, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000004_0, offset: 1024, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4679373457794758132_1177, duration: 160651
2013-10-31 20:37:53,242 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000000_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 20:37:53,243 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000000_0 is done.
2013-10-31 20:37:53,244 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000000_0 was 72
2013-10-31 20:37:53,244 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:53,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 20:37:53,267 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35127, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000005_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-1710730409183361578_1012, duration: 128037
2013-10-31 20:37:53,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 20:37:53,275 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35128, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031202710049_0020_m_000004_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_4376294229090259720_1013, duration: 131587
2013-10-31 20:37:53,801 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0020_m_000007_0
2013-10-31 20:37:53,801 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0020_m_000007_0
2013-10-31 20:37:53,801 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031202710049_0020_m_000007_0 not found in cache
2013-10-31 20:37:54,804 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000000_0' has completed task_20131031202710049_0020_m_000000 successfully.
2013-10-31 20:37:54,806 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000001_0' has completed task_20131031202710049_0020_m_000001 successfully.
2013-10-31 20:37:54,807 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031202710049_0020_r_000000_0' to tip task_20131031202710049_0020_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:37:54,811 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_r_000000_0 task's state:UNASSIGNED
2013-10-31 20:37:54,812 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_r_000000_0 which needs 1 slots
2013-10-31 20:37:54,812 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0020_r_000000_0 which needs 1 slots
2013-10-31 20:37:54,847 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031202710049_0020_r_1833273752
2013-10-31 20:37:54,848 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031202710049_0020_r_1833273752 spawned.
2013-10-31 20:37:54,850 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031202710049_0020/attempt_20131031202710049_0020_r_000000_0/taskjvm.sh
2013-10-31 20:37:55,391 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000002_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 20:37:55,392 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000003_0 1.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 20:37:55,393 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000002_0 is done.
2013-10-31 20:37:55,393 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000002_0 was 72
2013-10-31 20:37:55,393 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:37:55,393 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000003_0 is done.
2013-10-31 20:37:55,393 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000003_0 was 50
2013-10-31 20:37:55,393 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:55,765 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_r_1833273752 given task: attempt_20131031202710049_0020_r_000000_0
2013-10-31 20:37:56,153 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000005_0 0.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 20:37:56,154 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000004_0 0.0% hdfs://localhost:52817/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 20:37:56,155 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000005_0 is done.
2013-10-31 20:37:56,155 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000005_0 was 6
2013-10-31 20:37:56,155 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 20:37:56,155 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000004_0 is done.
2013-10-31 20:37:56,155 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000004_0 was 6
2013-10-31 20:37:56,155 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:37:56,761 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000002_0' has completed task_20131031202710049_0020_m_000002 successfully.
2013-10-31 20:37:56,763 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000003_0' has completed task_20131031202710049_0020_m_000003 successfully.
2013-10-31 20:37:57,440 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000004_0' has completed task_20131031202710049_0020_m_000004 successfully.
2013-10-31 20:37:57,442 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000005_0' has completed task_20131031202710049_0020_m_000005 successfully.
2013-10-31 20:38:01,448 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:46194, bytes: 72, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0020_m_000000_0, duration: 6189157
2013-10-31 20:38:01,471 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34635, dest: 10.5.128.102:46194, bytes: 50, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0020_m_000001_0, duration: 14974032
2013-10-31 20:38:01,489 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53799, bytes: 72, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0020_m_000002_0, duration: 10988959
2013-10-31 20:38:01,501 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:34334, dest: 10.5.128.102:53799, bytes: 50, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0020_m_000003_0, duration: 8554709
2013-10-31 20:38:01,514 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:54174, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0020_m_000004_0, duration: 9374133
2013-10-31 20:38:01,525 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59617, dest: 10.5.128.102:54174, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031202710049_0020_m_000005_0, duration: 8542640
2013-10-31 20:38:02,276 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:38:02,326 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:38:02,392 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:38:02,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:38:03,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:38:03,181 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0/part-00000. blk_-6005603903929809149_1183
2013-10-31 20:38:03,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6005603903929809149_1183 src: /127.0.0.1:40625 dest: /127.0.0.1:46399
2013-10-31 20:38:03,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6005603903929809149_1183 src: /127.0.0.1:44918 dest: /127.0.0.1:33202
2013-10-31 20:38:03,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6005603903929809149_1183 src: /127.0.0.1:35137 dest: /127.0.0.1:37249
2013-10-31 20:38:03,227 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35137, dest: /127.0.0.1:37249, bytes: 1070, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0020_r_000000_0, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6005603903929809149_1183, duration: 2954078
2013-10-31 20:38:03,227 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6005603903929809149_1183 terminating
2013-10-31 20:38:03,227 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44918, dest: /127.0.0.1:33202, bytes: 1070, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0020_r_000000_0, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-6005603903929809149_1183, duration: 2786276
2013-10-31 20:38:03,227 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6005603903929809149_1183 terminating
2013-10-31 20:38:03,228 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:40625, dest: /127.0.0.1:46399, bytes: 1070, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031202710049_0020_r_000000_0, offset: 0, srvID: DS-1218196606-10.5.128.102-46399-1383251229561, blockid: blk_-6005603903929809149_1183, duration: 3870769
2013-10-31 20:38:03,228 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6005603903929809149_1183 terminating
2013-10-31 20:38:03,232 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-6005603903929809149_1183 size 1070
2013-10-31 20:38:03,232 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-6005603903929809149_1183 size 1070
2013-10-31 20:38:03,232 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46399 is added to blk_-6005603903929809149_1183 size 1070
2013-10-31 20:38:03,631 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0/part-00000 from client DFSClient_attempt_20131031202710049_0020_r_000000_0
2013-10-31 20:38:03,632 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031202710049_0020_r_000000_0
2013-10-31 20:38:03,685 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031202710049_0020_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 20:38:03,685 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 20:38:03,819 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031202710049_0020_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:46857
2013-10-31 20:38:03,821 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031202710049_0020_r_000000_0
2013-10-31 20:38:04,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0 dst=null perm=null
2013-10-31 20:38:04,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 20:38:04,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:38:04,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary/_attempt_20131031202710049_0020_r_000000_0 dst=null perm=null
2013-10-31 20:38:05,325 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_r_000000_0 1.0% reduce > reduce
2013-10-31 20:38:05,328 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_r_000000_0 1.0% reduce > reduce
2013-10-31 20:38:05,329 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_r_000000_0 is done.
2013-10-31 20:38:05,329 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_r_000000_0 was -1
2013-10-31 20:38:05,329 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:38:06,823 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_r_000000_0' has completed task_20131031202710049_0020_r_000000 successfully.
2013-10-31 20:38:06,828 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031202710049_0020_m_000006_0' to tip task_20131031202710049_0020_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:46857'
2013-10-31 20:38:06,831 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031202710049_0020_m_000006_0 task's state:UNASSIGNED
2013-10-31 20:38:06,831 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031202710049_0020_m_000006_0 which needs 1 slots
2013-10-31 20:38:06,832 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031202710049_0020_m_000006_0 which needs 1 slots
2013-10-31 20:38:06,867 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031202710049_0020/attempt_20131031202710049_0020_m_000006_0. Attempting to reuse: jvm_20131031202710049_0020_m_113604213
2013-10-31 20:38:07,294 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031202710049_0020_m_113604213 given task: attempt_20131031202710049_0020_m_000006_0
2013-10-31 20:38:07,419 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000006_0 0.0%
2013-10-31 20:38:07,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary dst=null perm=null
2013-10-31 20:38:07,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 20:38:07,438 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_SUCCESS from client DFSClient_attempt_20131031202710049_0020_m_000006_0
2013-10-31 20:38:07,439 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_SUCCESS is closed by DFSClient_attempt_20131031202710049_0020_m_000006_0
2013-10-31 20:38:07,445 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8439516101647958281 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8439516101647958281 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8439516101647958281 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8439516101647958281 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679373457794758132 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679373457794758132 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679373457794758132 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679373457794758132 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4157729086671526904 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4157729086671526904 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4157729086671526904 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1570148205970777119 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:38:07,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1570148205970777119 is added to invalidSet of 127.0.0.1:49827
2013-10-31 20:38:07,447 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1570148205970777119 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:38:07,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031202710049_0020 dst=null perm=null
2013-10-31 20:38:07,514 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:46399 to delete blk_8439516101647958281_1176 blk_4679373457794758132_1177 blk_-4157729086671526904_1178
2013-10-31 20:38:07,514 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:33202 to delete blk_8439516101647958281_1176 blk_4679373457794758132_1177 blk_-1570148205970777119_1179
2013-10-31 20:38:08,052 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 20:38:08,063 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:38:08,068 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:38:08,074 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:38:08,079 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:38:08,085 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:38:08,090 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_24450_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 20:38:08,090 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 20:38:09,398 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1570148205970777119_1179 file build/test/data/dfs/data/data3/current/blk_-1570148205970777119 for deletion
2013-10-31 20:38:09,398 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679373457794758132_1177 file build/test/data/dfs/data/data4/current/blk_4679373457794758132 for deletion
2013-10-31 20:38:09,398 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1570148205970777119_1179 at file build/test/data/dfs/data/data3/current/blk_-1570148205970777119
2013-10-31 20:38:09,398 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8439516101647958281_1176 file build/test/data/dfs/data/data3/current/blk_8439516101647958281 for deletion
2013-10-31 20:38:09,398 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679373457794758132_1177 at file build/test/data/dfs/data/data4/current/blk_4679373457794758132
2013-10-31 20:38:09,399 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8439516101647958281_1176 at file build/test/data/dfs/data/data3/current/blk_8439516101647958281
2013-10-31 20:38:09,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4157729086671526904_1178 file build/test/data/dfs/data/data5/current/blk_-4157729086671526904 for deletion
2013-10-31 20:38:09,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679373457794758132_1177 file build/test/data/dfs/data/data6/current/blk_4679373457794758132 for deletion
2013-10-31 20:38:09,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4157729086671526904_1178 at file build/test/data/dfs/data/data5/current/blk_-4157729086671526904
2013-10-31 20:38:09,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8439516101647958281_1176 file build/test/data/dfs/data/data5/current/blk_8439516101647958281 for deletion
2013-10-31 20:38:09,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679373457794758132_1177 at file build/test/data/dfs/data/data6/current/blk_4679373457794758132
2013-10-31 20:38:09,844 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8439516101647958281_1176 at file build/test/data/dfs/data/data5/current/blk_8439516101647958281
2013-10-31 20:38:10,370 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031202710049_0020_m_000006_0 0.0% cleanup
2013-10-31 20:38:10,371 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031202710049_0020_m_000006_0 is done.
2013-10-31 20:38:10,372 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031202710049_0020_m_000006_0 was -1
2013-10-31 20:38:10,372 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 20:38:10,515 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:49827 to delete blk_8439516101647958281_1176 blk_4679373457794758132_1177 blk_-4157729086671526904_1178 blk_-1570148205970777119_1179
2013-10-31 20:38:10,515 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37249 to delete blk_8439516101647958281_1176 blk_4679373457794758132_1177 blk_-4157729086671526904_1178 blk_-1570148205970777119_1179
2013-10-31 20:38:11,832 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031202710049_0020_r_000000_0
2013-10-31 20:38:11,832 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031202710049_0020_r_000000_0
2013-10-31 20:38:11,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4157729086671526904_1178 file build/test/data/dfs/data/data2/current/blk_-4157729086671526904 for deletion
2013-10-31 20:38:11,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1570148205970777119_1179 file build/test/data/dfs/data/data1/current/blk_-1570148205970777119 for deletion
2013-10-31 20:38:11,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4157729086671526904_1178 at file build/test/data/dfs/data/data2/current/blk_-4157729086671526904
2013-10-31 20:38:11,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679373457794758132_1177 file build/test/data/dfs/data/data1/current/blk_4679373457794758132 for deletion
2013-10-31 20:38:11,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1570148205970777119_1179 at file build/test/data/dfs/data/data1/current/blk_-1570148205970777119
2013-10-31 20:38:11,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8439516101647958281_1176 file build/test/data/dfs/data/data2/current/blk_8439516101647958281 for deletion
2013-10-31 20:38:11,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679373457794758132_1177 at file build/test/data/dfs/data/data1/current/blk_4679373457794758132
2013-10-31 20:38:11,954 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8439516101647958281_1176 at file build/test/data/dfs/data/data2/current/blk_8439516101647958281
2013-10-31 20:38:12,839 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031202710049_0020_m_000006_0' has completed task_20131031202710049_0020_m_000006 successfully.
2013-10-31 20:38:12,840 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031202710049_0020 has completed successfully.
2013-10-31 20:38:12,840 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031202710049_0020,submitTime=1383251862471,launchTime=1383251862578,firstMapTaskLaunchTime=1383251868794,firstReduceTaskLaunchTime=1383251874807,firstJobSetupTaskLaunchTime=1383251862773,firstJobCleanupTaskLaunchTime=1383251886828,finishTime=1383251892840,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[CC358D4111564BE6A92B4B84203E2C63/A957155F623D434F8C5B7EE1FF449554] lower*upper/(1/1) ...platform/customerwritable
2013-10-31 20:38:12,847 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_1383251862471_hadoop_%5BCC358D4111564BE6A92B4B84203E2C63%2FA957155F623D434F. blk_-5958370518758990081_1184
2013-10-31 20:38:12,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5958370518758990081_1184 src: /127.0.0.1:35140 dest: /127.0.0.1:37249
2013-10-31 20:38:12,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5958370518758990081_1184 src: /127.0.0.1:36537 dest: /127.0.0.1:49827
2013-10-31 20:38:12,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5958370518758990081_1184 src: /127.0.0.1:44924 dest: /127.0.0.1:33202
2013-10-31 20:38:12,859 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44924, dest: /127.0.0.1:33202, bytes: 36176, op: HDFS_WRITE, cliID: DFSClient_-898365597, offset: 0, srvID: DS-847897947-10.5.128.102-33202-1383251229143, blockid: blk_-5958370518758990081_1184, duration: 1042702
2013-10-31 20:38:12,859 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5958370518758990081_1184 terminating
2013-10-31 20:38:12,860 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36537, dest: /127.0.0.1:49827, bytes: 36176, op: HDFS_WRITE, cliID: DFSClient_-898365597, offset: 0, srvID: DS-1604804401-10.5.128.102-49827-1383251229957, blockid: blk_-5958370518758990081_1184, duration: 2525261
2013-10-31 20:38:12,861 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5958370518758990081_1184 terminating
2013-10-31 20:38:12,862 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35140, dest: /127.0.0.1:37249, bytes: 36176, op: HDFS_WRITE, cliID: DFSClient_-898365597, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-5958370518758990081_1184, duration: 4133179
2013-10-31 20:38:12,863 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5958370518758990081_1184 terminating
2013-10-31 20:38:12,869 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49827 is added to blk_-5958370518758990081_1184 size 36176
2013-10-31 20:38:12,869 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_1383251862471_hadoop_%5BCC358D4111564BE6A92B4B84203E2C63%2FA957155F623D434F from client DFSClient_-898365597
2013-10-31 20:38:12,870 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_logs/history/job_20131031202710049_0020_1383251862471_hadoop_%5BCC358D4111564BE6A92B4B84203E2C63%2FA957155F623D434F is closed by DFSClient_-898365597
2013-10-31 20:38:12,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37249 is added to blk_-5958370518758990081_1184 size 36176
2013-10-31 20:38:12,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:33202 is added to blk_-5958370518758990081_1184 size 36176
2013-10-31 20:38:12,876 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0020_1383251862471_hadoop_%5BCC358D4111564BE6A92B4B84203E2C63%2FA957155F623D434F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:38:12,877 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0020_m_000000_0'
2013-10-31 20:38:12,877 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0020_m_000001_0'
2013-10-31 20:38:12,877 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0020_m_000006_0'
2013-10-31 20:38:12,877 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0020_m_000007_0'
2013-10-31 20:38:12,878 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031202710049_0020_r_000000_0'
2013-10-31 20:38:12,878 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6221039576746366958 is added to invalidSet of 127.0.0.1:33202
2013-10-31 20:38:12,879 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6221039576746366958 is added to invalidSet of 127.0.0.1:37249
2013-10-31 20:38:12,879 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6221039576746366958 is added to invalidSet of 127.0.0.1:46399
2013-10-31 20:38:12,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031202710049_0020 dst=null perm=null
2013-10-31 20:38:12,883 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031202710049_0020_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383251230165_/2013/10/31/000000
2013-10-31 20:38:12,889 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/_temporary
2013-10-31 20:38:12,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable dst=null perm=null
2013-10-31 20:38:12,905 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 20:38:12,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/part-00000 dst=null perm=null
2013-10-31 20:38:12,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/part-00000 dst=null perm=null
2013-10-31 20:38:12,910 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35144, bytes: 1082, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6005603903929809149_1183, duration: 381962
2013-10-31 20:38:12,911 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/serializedpipesplatform/customerwritable
2013-10-31 20:38:12,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable dst=null perm=null
2013-10-31 20:38:12,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/serializedpipesplatform/customerwritable/part-00000 dst=null perm=null
2013-10-31 20:38:12,917 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37249, dest: /127.0.0.1:35145, bytes: 1082, op: HDFS_READ, cliID: DFSClient_848976415, offset: 0, srvID: DS-962712564-10.5.128.102-37249-1383251228659, blockid: blk_-6005603903929809149_1183, duration: 396040